2024-09-20T23:00:48.050 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T23:00:48.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T23:00:48.149 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7913053' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_STRAY_DAEMON - CEPHADM_FAILED_DAEMON - CEPHADM_AGENT_DOWN log-only-match: - CEPHADM_ sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 9344 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 56/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEumkQxrrBczQZCarYfKH4iaYjYcsMBWHsJLnawp7bMhd+nOnzq459A6f1nOodcVxwtoW/3zcquYM34DeufmVWY= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPitEx3kjVJfJlvBNN2+XSNpCxLcx85edWNqu7DFY4W35ghrQ4HOK8RTlW10I52zWBvx6lir+Kx6rD45H0Aszjg= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph orch apply rgw smpl - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-20T23:00:48.149 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-20T23:00:48.150 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-20T23:00:48.150 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T23:00:48.152 INFO:teuthology.task.internal:Checking packages... 2024-09-20T23:00:48.171 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-20T23:00:48.171 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T23:00:48.172 INFO:teuthology.packaging:ref: None 2024-09-20T23:00:48.172 INFO:teuthology.packaging:tag: None 2024-09-20T23:00:48.172 INFO:teuthology.packaging:branch: squid 2024-09-20T23:00:48.172 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:00:48.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T23:00:48.381 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-20T23:00:48.383 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T23:00:48.390 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T23:00:48.390 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T23:00:48.430 INFO:teuthology.task.internal:Saving configuration 2024-09-20T23:00:48.455 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T23:00:48.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T23:00:48.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 22:55:48.973832', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEumkQxrrBczQZCarYfKH4iaYjYcsMBWHsJLnawp7bMhd+nOnzq459A6f1nOodcVxwtoW/3zcquYM34DeufmVWY='} 2024-09-20T23:00:48.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 22:55:48.975701', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPitEx3kjVJfJlvBNN2+XSNpCxLcx85edWNqu7DFY4W35ghrQ4HOK8RTlW10I52zWBvx6lir+Kx6rD45H0Aszjg='} 2024-09-20T23:00:48.513 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T23:00:48.519 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-09-20T23:00:48.519 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-09-20T23:00:48.519 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T23:00:48.596 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a31ac0160>, signals=[15]) 2024-09-20T23:00:48.597 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T23:00:48.603 INFO:teuthology.task.internal:Opening connections... 2024-09-20T23:00:48.603 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:00:48.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:00:48.679 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-09-20T23:00:48.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:00:48.754 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T23:00:48.760 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-09-20T23:00:48.779 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-09-20T23:00:48.779 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-09-20T23:00:48.836 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-09-20T23:00:48.836 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-09-20T23:00:48.836 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-09-20T23:00:48.836 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-09-20T23:00:48.836 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T23:00:48.837 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T23:00:48.838 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-09-20T23:00:48.861 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-09-20T23:00:48.879 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-09-20T23:00:48.879 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-09-20T23:00:48.937 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-09-20T23:00:48.938 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T23:00:48.939 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T23:00:48.939 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T23:00:48.939 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-09-20T23:00:48.960 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T23:00:48.975 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T23:00:49.004 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T23:00:49.005 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-09-20T23:00:49.007 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-09-20T23:00:49.024 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T23:00:49.055 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T23:00:49.055 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-09-20T23:00:49.065 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-09-20T23:00:49.089 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T23:00:49.142 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T23:00:49.157 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T23:00:49.157 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T23:00:49.157 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T23:00:49.158 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T23:00:49.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:00:49.174 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-09-20T23:00:49.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:00:49.176 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-20T23:00:49.232 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-503.el9.x86_64 2024-09-20T23:00:49.232 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-503.el9.x86_64 2024-09-20T23:00:49.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-09-20T23:00:49.233 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-503.el9.x86_64 2024-09-20T23:00:49.234 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-503.el9.x86_64 2024-09-20T23:00:49.234 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-09-20T23:00:51.823 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-20T23:00:52.880 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-20T23:00:53.558 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-20T23:00:54.807 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-20T23:00:58.567 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-20T23:00:59.983 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-20T23:01:00.434 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-20T23:01:01.451 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-20T23:01:01.596 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-20T23:01:02.239 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-20T23:01:07.011 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-20T23:01:07.687 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-20T23:01:08.918 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T23:01:08.918 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T23:01:09.008 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-20T23:01:09.020 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-20T23:01:09.021 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:01:09.022 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 79 M 2024-09-20T23:01:09.022 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 126 M 2024-09-20T23:01:09.022 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-20T23:01:09.188 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 305 kB/s | 36 kB 00:00 2024-09-20T23:01:09.594 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T23:01:09.594 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T23:01:09.680 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-20T23:01:09.691 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-20T23:01:09.691 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout:Install 4 Packages 2024-09-20T23:01:09.692 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:01:09.693 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 79 M 2024-09-20T23:01:09.693 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 126 M 2024-09-20T23:01:09.693 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-20T23:01:10.030 INFO:teuthology.orchestra.run.smithi191.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 448 kB/s | 36 kB 00:00 2024-09-20T23:01:10.614 INFO:teuthology.orchestra.run.smithi191.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-20T23:01:11.240 INFO:teuthology.orchestra.run.smithi191.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-20T23:01:11.657 INFO:teuthology.orchestra.run.smithi191.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-20T23:01:11.657 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-20T23:01:11.657 INFO:teuthology.orchestra.run.smithi191.stdout:Total 40 MB/s | 79 MB 00:01 2024-09-20T23:01:12.344 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-20T23:01:12.690 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-20T23:01:12.690 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-20T23:01:13.079 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 7.3 MB/s | 29 MB 00:03 2024-09-20T23:01:13.237 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-20T23:01:13.555 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.7 MB/s | 35 MB 00:04 2024-09-20T23:01:13.555 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-20T23:01:13.555 INFO:teuthology.orchestra.run.smithi170.stdout:Total 17 MB/s | 79 MB 00:04 2024-09-20T23:01:13.642 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-20T23:01:13.642 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-20T23:01:14.243 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-20T23:01:14.608 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-20T23:01:14.608 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-20T23:01:15.549 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-20T23:01:15.550 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-20T23:01:16.071 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-20T23:01:16.788 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T23:01:16.872 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:01:17.992 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-20T23:01:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T23:01:18.714 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:01:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:01:19.769 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:01:21.467 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:01:21.601 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:01:24.608 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:01:24.646 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:01:26.428 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:01:26.468 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:01:29.522 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:01:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:07.596 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:07.636 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:07.916 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:07.917 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T23:02:07.917 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:02:07.917 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:02:08.774 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:08.774 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:02:08.774 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-20T23:02:08.774 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:08.774 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T23:02:08.775 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T23:02:08.775 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T23:02:08.775 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:02:08.775 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-20T23:02:09.159 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T23:02:09.255 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:09.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T23:02:09.255 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T23:02:09.255 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T23:02:09.255 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T23:02:09.255 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-20T23:02:09.255 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T23:02:09.256 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T23:02:09.315 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:09.315 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T23:02:09.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2024-09-20T23:02:09.351 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.06 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 82.el9 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Group : Unspecified 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 8274670 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T23:02:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : builder@centos.org 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : CentOS 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:02:09.353 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T23:02:09.354 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T23:02:09.354 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 5.14.0-508.el9.x86_64 2024-09-20T23:02:09.354 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T23:02:09.594 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:09.634 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:09.973 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:09.973 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T23:02:09.973 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T23:02:09.973 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T23:02:09.985 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:02:10.861 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-20T23:02:11.224 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T23:02:11.313 INFO:teuthology.orchestra.run.smithi191.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T23:02:11.316 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:11.316 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T23:02:11.317 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T23:02:11.317 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T23:02:11.317 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T23:02:11.317 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-20T23:02:11.317 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T23:02:11.317 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T23:02:11.345 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-09-20T23:02:11.347 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-09-20T23:02:11.362 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.EfPVoosAoN 2024-09-20T23:02:11.362 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EfPVoosAoN 2024-09-20T23:02:11.375 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T23:02:11.375 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T23:02:11.376 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 82.el9 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-09-20T23:02:11.417 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8274670 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T23:02:11.418 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T23:02:11.419 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-09-20T23:02:11.419 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:02:11.419 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T23:02:11.419 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T23:02:11.420 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-508.el9.x86_64 2024-09-20T23:02:11.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T23:02:11.429 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.EfPVoosAoN 2024-09-20T23:02:11.567 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.EfPVoosAoN is 6KB 2024-09-20T23:02:11.615 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.EfPVoosAoN 2024-09-20T23:02:11.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T23:02:11.693 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T23:02:11.694 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T23:02:11.694 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T23:02:11.694 INFO:teuthology.orchestra.run.smithi191.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T23:02:11.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T23:02:11.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-09-20T23:02:12.067 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-09-20T23:02:13.361 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T23:02:13.386 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-09-20T23:02:13.388 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-09-20T23:02:13.404 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.gN1bfQuLPK 2024-09-20T23:02:13.404 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gN1bfQuLPK 2024-09-20T23:02:13.471 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.gN1bfQuLPK 2024-09-20T23:02:13.600 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.gN1bfQuLPK is 6KB 2024-09-20T23:02:13.647 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.gN1bfQuLPK 2024-09-20T23:02:13.662 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T23:02:13.724 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T23:02:13.724 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T23:02:13.725 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T23:02:13.725 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T23:02:13.726 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T23:02:13.885 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-09-20T23:02:41.864 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-20T23:02:41.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:02:41.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:02:43.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-20T23:02:43.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:02:43.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:03:00.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-20T23:03:02.383 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-09-20T23:03:09.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:03:09.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:03:11.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:03:11.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:03:12.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-09-20T23:03:14.447 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-09-20T23:03:24.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:03:24.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:03:26.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:03:26.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:03:56.497 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-20T23:03:57.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:03:57.226 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-20T23:03:57.227 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-09-20T23:03:57.241 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-508.el9.x86_64 2024-09-20T23:03:57.241 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T23:03:57.241 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T23:03:57.242 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T23:03:58.243 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-20T23:03:58.243 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T23:03:58.292 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-20T23:03:58.295 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-09-20T23:03:58.317 DEBUG:teuthology.parallel:result is None 2024-09-20T23:03:58.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:03:58.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-20T23:03:58.805 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-20T23:03:58.819 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-508.el9.x86_64 2024-09-20T23:03:58.820 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T23:03:58.820 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T23:03:58.820 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T23:03:59.820 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-20T23:03:59.820 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T23:04:00.067 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-09-20T23:04:00.088 DEBUG:teuthology.parallel:result is None 2024-09-20T23:04:00.088 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T23:04:00.095 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T23:04:00.095 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T23:04:00.099 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T23:04:00.122 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T23:04:00.146 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T23:04:00.180 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T23:04:00.181 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T23:04:00.183 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T23:04:00.316 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T23:04:00.323 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T23:04:00.323 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T23:04:00.325 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T23:04:00.358 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T23:04:00.370 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T23:04:00.509 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T23:04:00.539 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T23:04:00.541 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T23:04:00.548 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T23:04:00.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T23:04:00.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T23:04:00.612 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T23:04:00.621 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T23:04:00.621 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T23:04:00.623 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T23:04:00.658 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T23:04:00.778 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T23:04:00.852 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T23:04:00.924 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T23:04:00.982 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:04:00.982 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T23:04:01.040 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T23:04:01.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T23:04:01.183 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T23:04:01.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T23:04:01.270 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:04:01.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T23:04:01.336 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-09-20T23:04:01.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-09-20T23:04:01.382 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T23:04:01.421 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T23:04:01.760 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T23:04:01.769 INFO:teuthology.task.internal:Starting timer... 2024-09-20T23:04:01.769 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T23:04:01.833 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T23:04:01.867 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-09-20T23:04:01.966 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-09-20T23:04:01.968 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-09-20T23:04:02.049 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-09-20T23:04:02.051 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T23:04:02.051 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-09-20T23:04:02.078 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-09-20T23:04:02.078 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-09-20T23:04:02.111 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-09-20T23:04:02.112 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi170.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-09-20T23:04:02.112 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-20T23:04:02.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:04:02.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-20T23:04:02.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:04:02.179 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T23:04:02.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-09-20T23:04:02.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-09-20T23:04:02.256 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T23:04:02.266 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T23:04:02.275 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T23:04:02.276 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi170.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T23:07:42.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-09-20T23:07:42.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:07:42.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:07:42.708 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-20T23:07:42.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-20T23:07:42.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:07:42.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T23:07:42.865 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-20T23:07:42.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-20T23:07:42.946 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T23:07:42.955 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T23:07:42.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T23:07:42.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T23:07:42.958 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T23:07:42.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T23:07:42.985 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T23:07:42.999 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T23:07:43.015 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T23:07:43.023 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-09-20T23:07:43.028 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T23:07:43.034 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-09-20T23:07:43.048 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T23:07:43.053 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-09-20T23:07:43.063 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T23:07:43.064 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-09-20T23:07:43.078 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T23:07:43.092 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T23:07:43.119 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.122 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.146 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-20T23:07:43.149 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T23:07:43.150 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-20T23:07:43.150 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.150 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.150 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.150 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:07:43.151 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-20T23:07:43.229 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_FAILED_DAEMON', 'CEPHADM_AGENT_DOWN'], 'log-only-match': ['CEPHADM_'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-20T23:07:43.229 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-09-20T23:07:43.229 INFO:tasks.cephadm:Cluster fsid is 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:07:43.229 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-20T23:07:43.230 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.170', 'mon.c': '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]', 'mon.b': '172.21.15.191'} 2024-09-20T23:07:43.230 INFO:tasks.cephadm:First mon is mon.a on smithi170 2024-09-20T23:07:43.230 INFO:tasks.cephadm:First mgr is y 2024-09-20T23:07:43.230 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-20T23:07:43.230 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-09-20T23:07:43.255 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-09-20T23:07:43.281 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-09-20T23:07:43.281 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.510 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Sep 20 23:07 /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.510 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.630 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Sep 20 23:07 /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.630 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.646 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T23:07:43.671 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-09-20T23:07:43.671 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-09-20T23:07:43.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-09-20T23:07:45.277 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-20T23:07:45.480 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-09-20T23:07:57.422 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-20T23:07:57.771 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-09-20T23:07:57.772 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:07:57.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-09-20T23:07:57.836 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-09-20T23:07:57.865 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-09-20T23:07:57.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-09-20T23:07:57.931 INFO:tasks.cephadm:Writing seed config... 2024-09-20T23:07:57.932 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-20T23:07:57.933 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-20T23:07:57.934 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:07:57.934 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-20T23:07:57.949 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 243152d6-77a5-11ef-baf5-efdc52797490 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-20T23:07:57.949 DEBUG:teuthology.orchestra.run.smithi170:mon.a> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service 2024-09-20T23:07:57.991 DEBUG:teuthology.orchestra.run.smithi170:mgr.y> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service 2024-09-20T23:07:58.033 INFO:tasks.cephadm:Bootstrapping... 2024-09-20T23:07:58.033 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid 243152d6-77a5-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.170 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:07:58.224 INFO:teuthology.orchestra.run.smithi170.stderr:-------------------------------------------------------------------------------- 2024-09-20T23:07:58.224 INFO:teuthology.orchestra.run.smithi170.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', '243152d6-77a5-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.170', '--skip-admin-label'] 2024-09-20T23:07:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: 5.2.2 2024-09-20T23:07:58.248 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying podman|docker is present... 2024-09-20T23:07:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: 5.2.2 2024-09-20T23:07:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying lvm2 is present... 2024-09-20T23:07:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying time synchronization is in place... 2024-09-20T23:07:58.277 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T23:07:58.283 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:07:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: enabled 2024-09-20T23:07:58.296 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: active 2024-09-20T23:07:58.297 INFO:teuthology.orchestra.run.smithi170.stderr:Unit chronyd.service is enabled and running 2024-09-20T23:07:58.297 INFO:teuthology.orchestra.run.smithi170.stderr:Repeating the final host check... 2024-09-20T23:07:58.317 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: 5.2.2 2024-09-20T23:07:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:podman (/bin/podman) version 5.2.2 is present 2024-09-20T23:07:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl is present 2024-09-20T23:07:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:lvcreate is present 2024-09-20T23:07:58.325 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T23:07:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:07:58.338 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: enabled 2024-09-20T23:07:58.344 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: active 2024-09-20T23:07:58.345 INFO:teuthology.orchestra.run.smithi170.stderr:Unit chronyd.service is enabled and running 2024-09-20T23:07:58.345 INFO:teuthology.orchestra.run.smithi170.stderr:Host looks OK 2024-09-20T23:07:58.345 INFO:teuthology.orchestra.run.smithi170.stderr:Cluster fsid: 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:07:58.345 INFO:teuthology.orchestra.run.smithi170.stderr:Acquiring lock 139961640297088 on /run/cephadm/243152d6-77a5-11ef-baf5-efdc52797490.lock 2024-09-20T23:07:58.346 INFO:teuthology.orchestra.run.smithi170.stderr:Lock 139961640297088 acquired on /run/cephadm/243152d6-77a5-11ef-baf5-efdc52797490.lock 2024-09-20T23:07:58.346 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying IP 172.21.15.170 port 3300 ... 2024-09-20T23:07:58.346 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying IP 172.21.15.170 port 6789 ... 2024-09-20T23:07:58.346 INFO:teuthology.orchestra.run.smithi170.stderr:Base mon IP is 172.21.15.170, final addrv is [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-09-20T23:07:58.348 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.170 metric 100 2024-09-20T23:07:58.348 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.170 metric 100 2024-09-20T23:07:58.351 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-09-20T23:07:58.351 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-20T23:07:58.351 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe88:7255/64 scope link noprefixroute 2024-09-20T23:07:58.354 INFO:teuthology.orchestra.run.smithi170.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-09-20T23:07:58.355 INFO:teuthology.orchestra.run.smithi170.stderr:Mon IP `172.21.15.170` is in CIDR network `172.21.0.0/20` 2024-09-20T23:07:58.355 INFO:teuthology.orchestra.run.smithi170.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-20T23:07:58.355 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-20T23:07:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Getting image source signatures 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-09-20T23:07:58.817 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-09-20T23:07:58.818 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-09-20T23:07:58.951 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: Writing manifest to image destination 2024-09-20T23:07:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-09-20T23:07:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-09-20T23:08:00.087 INFO:teuthology.orchestra.run.smithi170.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-09-20T23:08:00.087 INFO:teuthology.orchestra.run.smithi170.stderr:Extracting ceph user uid/gid from container image... 2024-09-20T23:08:00.470 INFO:teuthology.orchestra.run.smithi170.stderr:stat: 167 167 2024-09-20T23:08:02.437 INFO:teuthology.orchestra.run.smithi170.stderr:Creating initial keys... 2024-09-20T23:08:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph-authtool: AQBVAO5mAlTrJxAAXPlYWJscFCoUEcabo6hCIA== 2024-09-20T23:08:12.948 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph-authtool: AQBcAO5mXk0lMxAAI/KWBz3FaWOmJU0YlmDTkw== 2024-09-20T23:08:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph-authtool: AQBdAO5m1oDjLhAALK3OmzbDl8jDi9CJJgyQWA== 2024-09-20T23:08:14.487 INFO:teuthology.orchestra.run.smithi170.stderr:Creating initial monmap... 2024-09-20T23:08:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T23:08:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-09-20T23:08:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr:monmaptool for a [v2:172.21.15.170:3300,v1:172.21.15.170:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr:setting min_mon_release = octopus 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: set fsid to 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:08:15.367 INFO:teuthology.orchestra.run.smithi170.stderr:Creating mon... 2024-09-20T23:08:16.373 INFO:teuthology.orchestra.run.smithi170.stderr:create mon.a on 2024-09-20T23:08:16.598 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-20T23:08:16.747 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target. 2024-09-20T23:08:16.747 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target. 2024-09-20T23:08:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Failed to reset failed state of unit ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-20T23:08:17.051 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Created symlink /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target.wants/ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490@.service. 2024-09-20T23:08:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 podman[23374]: 2024-09-20 23:08:17.332221528 +0000 UTC m=+0.016490352 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-09-20T23:08:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: disabled 2024-09-20T23:08:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:08:17.704 INFO:teuthology.orchestra.run.smithi170.stderr:firewalld.service is not enabled 2024-09-20T23:08:17.704 INFO:teuthology.orchestra.run.smithi170.stderr:Not possible to enable service . firewalld.service is not available 2024-09-20T23:08:17.704 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mon to start... 2024-09-20T23:08:17.704 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mon... 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 podman[23374]: 2024-09-20 23:08:17.599473846 +0000 UTC m=+0.283742662 container init 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, version=8, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 podman[23374]: 2024-09-20 23:08:17.602692366 +0000 UTC m=+0.286961180 container start 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, name=centos-stream, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, com.redhat.component=centos-stream-container, vcs-type=git, io.openshift.expose-services=, GIT_CLEAN=True, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, version=8) 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 ceph-mon[23393]: mkfs 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 ceph-mon[23393]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 bash[23374]: 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 2024-09-20T23:08:17.828 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:17 smithi170 systemd[1]: Started Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:08:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:18 smithi170 ceph-mon[23393]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T23:08:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:18 smithi170 ceph-mon[23393]: monmap e1: 1 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} 2024-09-20T23:08:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:18 smithi170 ceph-mon[23393]: fsmap 2024-09-20T23:08:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:18 smithi170 ceph-mon[23393]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T23:08:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:18 smithi170 ceph-mon[23393]: mgrmap e1: no daemons active 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: cluster: 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: id: 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: services: 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 1.23454s) 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mgr: no daemons active 2024-09-20T23:08:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: data: 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: pgs: 2024-09-20T23:08:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:mon is available 2024-09-20T23:08:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:Assimilating anything we can from ceph.conf... 2024-09-20T23:08:19.785 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:19 smithi170 ceph-mon[23393]: from='client.? 172.21.15.170:0/4050664803' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [global] 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: fsid = 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-09-20T23:08:20.038 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [mgr] 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [osd] 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-09-20T23:08:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-09-20T23:08:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:Generating new minimal ceph.conf... 2024-09-20T23:08:20.914 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:20 smithi170 ceph-mon[23393]: from='client.? 172.21.15.170:0/1966121923' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T23:08:20.914 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:20 smithi170 ceph-mon[23393]: from='client.? 172.21.15.170:0/1966121923' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T23:08:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:Restarting the monitor... 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 systemd[1]: Stopping Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 bash[23612]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon.a" found: no such container 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 ceph-mon[23393]: from='client.? 172.21.15.170:0/658779813' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[23388]: 2024-09-20T23:08:21.719+0000 7fbf1713e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[23388]: 2024-09-20T23:08:21.719+0000 7fbf1713e700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-20T23:08:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:21 smithi170 podman[23622]: 2024-09-20 23:08:21.761319079 +0000 UTC m=+0.183421100 container died 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, vcs-type=git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, io.buildah.version=1.19.8, ceph=True, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-09-20T23:08:22.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23622]: 2024-09-20 23:08:22.127808475 +0000 UTC m=+0.549910486 container cleanup 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, io.openshift.expose-services=, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, version=8, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , name=centos-stream) 2024-09-20T23:08:22.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 bash[23622]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a 2024-09-20T23:08:22.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 bash[23648]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon.a" found: no such container 2024-09-20T23:08:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23634]: 2024-09-20 23:08:22.428807631 +0000 UTC m=+0.669936659 container remove 680e2e9712223fd0c9beba921d48e476bdb228daeb005779fbcae3bce10f5b58 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, release=754, GIT_BRANCH=HEAD, architecture=x86_64, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., ceph=True, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, com.redhat.component=centos-stream-container, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-09-20T23:08:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-20T23:08:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 systemd[1]: Stopped Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:08:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 systemd[1]: Starting Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:08:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23714]: 2024-09-20 23:08:22.646453429 +0000 UTC m=+0.110549091 container create 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, name=centos-stream, io.buildah.version=1.19.8, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870) 2024-09-20T23:08:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23714]: 2024-09-20 23:08:22.552322506 +0000 UTC m=+0.016418128 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23714]: 2024-09-20 23:08:22.943151879 +0000 UTC m=+0.407247501 container init 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, architecture=x86_64, io.buildah.version=1.19.8, vcs-type=git, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, name=centos-stream, GIT_BRANCH=HEAD, vendor=Red Hat, Inc.) 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 podman[23714]: 2024-09-20 23:08:22.947022964 +0000 UTC m=+0.411118581 container start 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, version=8, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, distribution-scope=public, release=754, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, io.openshift.expose-services=, GIT_BRANCH=HEAD, GIT_CLEAN=True, architecture=x86_64, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: pidfile_write: ignore empty --pid-file 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: load: jerasure load: lrc 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: RocksDB version: 6.15.5 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Compile date Apr 18 2022 2024-09-20T23:08:23.034 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: DB SUMMARY 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: DB Session ID: 3KC5GXX0HQLB7Z0GVIXI 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82956 ; 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.env: 0x55b7c0cc6860 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.fs: Posix File System 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.info_log: 0x55b7c340ddc0 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:08:23.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.statistics: (nil) 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.use_fsync: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.db_log_dir: 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-09-20T23:08:23.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:08:23.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.write_buffer_manager: 0x55b7c34fe240 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:08:23.038 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.unordered_write: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.row_cache: None 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.wal_filter: None 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.preserve_deletes: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:08:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:08:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_open_files: -1 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Compression algorithms supported: 2024-09-20T23:08:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kZSTD supported: 0 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.merge_operator: 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_filter: None 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:08:23.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b7c33d9d00) 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_type: 0 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_shortening: 1 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: hash_index_allow_collision: 1 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: checksum: 1 2024-09-20T23:08:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout: no_block_cache: 0 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache: 0x55b7c3444170 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_options: 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: capacity : 536870912 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size: 4096 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:08:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout: partition_filters: 0 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: verify_compression: 0 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: format_version: 4 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_align: 0 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression: NoCompression 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:08:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.num_levels: 7 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:08:23.046 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:08:23.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.arena_block_size: 4194304 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:08:23.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.table_properties_collectors: 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:08:23.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.ttl: 2592000 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-09-20T23:08:23.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873702974429, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873702975181, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79358, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77621, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10057, "raw_average_key_size": 47, "raw_value_size": 71904, "raw_average_value_size": 337, "num_data_blocks": 10, "num_entries": 213, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726873702, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "14c53d63-47d9-433c-860a-bf61c8779653", "db_session_id": "3KC5GXX0HQLB7Z0GVIXI"}} 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873702975519, "job": 1, "event": "recovery_finished"} 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55b7c342aa80 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: DB pointer 0x55b7c343a000 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** DB Stats ** 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:08:23.051 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: L0 2/0 79.26 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Sum 2/0 79.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:08:23.052 INFO:journalctl@ceph.mon.a.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative compaction: 0.00 GB write, 23.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval compaction: 0.00 GB write, 23.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:08:23.053 INFO:journalctl@ceph.mon.a.smithi170.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: L0 2/0 79.26 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Sum 2/0 79.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.1 0.00 0.00 1 0.001 0 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:08:23.054 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative compaction: 0.00 GB write, 23.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: starting mon.a rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???) e1 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).mds e1 new map 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).mds e1 print_map 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: e1 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout: No filesystems configured 2024-09-20T23:08:23.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expand map: {default=false} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta from 'false' to 'false' 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expanded map: {default=false} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expand map: {default=info} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta from 'info' to 'info' 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expanded map: {default=info} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expand map: {default=daemon} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expanded map: {default=daemon} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expand map: {default=debug} 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta from 'debug' to 'debug' 2024-09-20T23:08:23.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:22 smithi170 ceph-mon[23733]: expand_channel_meta expanded map: {default=debug} 2024-09-20T23:08:23.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 ceph-mon[23733]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T23:08:23.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 ceph-mon[23733]: monmap e1: 1 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} 2024-09-20T23:08:23.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 ceph-mon[23733]: fsmap 2024-09-20T23:08:23.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 ceph-mon[23733]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T23:08:23.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 ceph-mon[23733]: mgrmap e1: no daemons active 2024-09-20T23:08:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:Setting mon public_network to 172.21.0.0/20 2024-09-20T23:08:23.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 bash[23714]: 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 2024-09-20T23:08:23.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:23 smithi170 systemd[1]: Started Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:08:24.261 INFO:teuthology.orchestra.run.smithi170.stderr:Wrote config to /etc/ceph/ceph.conf 2024-09-20T23:08:24.262 INFO:teuthology.orchestra.run.smithi170.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:08:24.262 INFO:teuthology.orchestra.run.smithi170.stderr:Creating mgr... 2024-09-20T23:08:24.262 INFO:teuthology.orchestra.run.smithi170.stderr:Verifying port 9283 ... 2024-09-20T23:08:24.439 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Failed to reset failed state of unit ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Unit ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service not loaded. 2024-09-20T23:08:24.446 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: Created symlink /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490.target.wants/ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service → /etc/systemd/system/ceph-243152d6-77a5-11ef-baf5-efdc52797490@.service. 2024-09-20T23:08:24.601 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:24 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:08:24.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:24 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1909599929' entity='client.admin' 2024-09-20T23:08:24.957 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:24 smithi170 podman[23947]: 2024-09-20 23:08:24.722380468 +0000 UTC m=+0.025624106 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-09-20T23:08:24.957 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:24 smithi170 podman[23947]: 2024-09-20 23:08:24.840711245 +0000 UTC m=+0.143954873 container create d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, vcs-type=git, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, name=centos-stream, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., RELEASE=HEAD, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, version=8, distribution-scope=public, GIT_CLEAN=True, ceph=True, release=754) 2024-09-20T23:08:25.175 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: disabled 2024-09-20T23:08:25.182 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:08:25.183 INFO:teuthology.orchestra.run.smithi170.stderr:firewalld.service is not enabled 2024-09-20T23:08:25.183 INFO:teuthology.orchestra.run.smithi170.stderr:Not possible to enable service . firewalld.service is not available 2024-09-20T23:08:25.192 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: disabled 2024-09-20T23:08:25.200 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:08:25.201 INFO:teuthology.orchestra.run.smithi170.stderr:firewalld.service is not enabled 2024-09-20T23:08:25.201 INFO:teuthology.orchestra.run.smithi170.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-09-20T23:08:25.201 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mgr to start... 2024-09-20T23:08:25.201 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mgr... 2024-09-20T23:08:25.329 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 podman[23947]: 2024-09-20 23:08:25.060048295 +0000 UTC m=+0.363291929 container init d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , io.openshift.expose-services=, io.buildah.version=1.19.8, ceph=True, release=754, GIT_CLEAN=True, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, vcs-type=git, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD) 2024-09-20T23:08:25.330 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 podman[23947]: 2024-09-20 23:08:25.062872643 +0000 UTC m=+0.366116271 container start d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, RELEASE=HEAD, io.buildah.version=1.19.8, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, release=754, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, version=8, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:08:25.330 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 bash[23947]: d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 2024-09-20T23:08:25.330 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:08:25.330 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.208+0000 7f3a8f5e1000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:08:25.330 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.294+0000 7f3a8f5e1000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:08:25.590 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.474+0000 7f3a8f5e1000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:08:25.590 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.563+0000 7f3a8f5e1000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:08:25.770 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsid": "243152d6-77a5-11ef-baf5-efdc52797490", 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "health": { 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "checks": {}, 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mutes": [] 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.771 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum": [ 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 0 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "a" 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "monmap": { 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osdmap": { 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:25.772 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-20T23:08:25.773 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-20T23:08:25.773 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-20T23:08:25.773 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-20T23:08:25.776 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-20T23:08:25.776 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-20T23:08:25.776 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.776 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgmap": { 2024-09-20T23:08:25.776 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsmap": { 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-20T23:08:25.777 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "available": false, 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modules": [ 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "iostat", 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "nfs", 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "restful" 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "servicemap": { 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modified": "2024-09-20T23:08:17.638254+0000", 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-20T23:08:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3201501054' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T23:08:25.920 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.700+0000 7f3a8f5e1000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:08:25.920 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:25.917+0000 7f3a8f5e1000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:08:26.295 INFO:teuthology.orchestra.run.smithi170.stderr:mgr not available, waiting (1/15)... 2024-09-20T23:08:26.507 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:26.253+0000 7f3a8f5e1000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:08:26.507 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:26.341+0000 7f3a8f5e1000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:08:26.507 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:26.504+0000 7f3a8f5e1000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:08:27.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:27.572+0000 7f3a8f5e1000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:08:27.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:27.660+0000 7f3a8f5e1000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:08:28.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:28.568+0000 7f3a8f5e1000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:08:29.202 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:28.878+0000 7f3a8f5e1000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:08:29.203 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.012+0000 7f3a8f5e1000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:08:29.203 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.100+0000 7f3a8f5e1000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:08:29.203 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.199+0000 7f3a8f5e1000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsid": "243152d6-77a5-11ef-baf5-efdc52797490", 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "health": { 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "checks": {}, 2024-09-20T23:08:29.381 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mutes": [] 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum": [ 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 0 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "a" 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "monmap": { 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.382 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osdmap": { 2024-09-20T23:08:29.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:29.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-20T23:08:29.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-20T23:08:29.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-20T23:08:29.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgmap": { 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-20T23:08:29.386 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsmap": { 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "available": false, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modules": [ 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "iostat", 2024-09-20T23:08:29.387 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "nfs", 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "restful" 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "servicemap": { 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modified": "2024-09-20T23:08:17.638254+0000", 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-20T23:08:29.388 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2140158703' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T23:08:29.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.291+0000 7f3a8f5e1000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:08:29.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.447+0000 7f3a8f5e1000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:08:29.899 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.542+0000 7f3a8f5e1000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:08:29.899 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.640+0000 7f3a8f5e1000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:08:29.902 INFO:teuthology.orchestra.run.smithi170.stderr:mgr not available, waiting (2/15)... 2024-09-20T23:08:30.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:29.933+0000 7f3a8f5e1000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:08:30.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:30.020+0000 7f3a8f5e1000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:08:30.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:30.109+0000 7f3a8f5e1000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:08:31.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:31.170+0000 7f3a8f5e1000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:08:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: Activating manager daemon y 2024-09-20T23:08:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: mgrmap e2: y(active, starting, since 0.00289282s) 2024-09-20T23:08:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:08:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: Manager daemon y is now available 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' 2024-09-20T23:08:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:31 smithi170 ceph-mon[23733]: from='mgr.14100 172.21.15.170:0/494132028' entity='mgr.y' 2024-09-20T23:08:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsid": "243152d6-77a5-11ef-baf5-efdc52797490", 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "health": { 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "checks": {}, 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mutes": [] 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum": [ 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 0 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "a" 2024-09-20T23:08:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "monmap": { 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osdmap": { 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-20T23:08:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-20T23:08:32.578 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgmap": { 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-20T23:08:32.579 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "fsmap": { 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "available": true, 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modules": [ 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "iostat", 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "nfs", 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "restful" 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ], 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:32.580 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "servicemap": { 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "modified": "2024-09-20T23:08:17.638254+0000", 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "services": {} 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: }, 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-20T23:08:32.581 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:mgr is available 2024-09-20T23:08:33.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:33 smithi170 ceph-mon[23733]: mgrmap e3: y(active, since 1.0064s) 2024-09-20T23:08:33.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:33 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/694517603' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T23:08:33.758 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:33.758 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [global] 2024-09-20T23:08:33.758 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: fsid = 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:33.758 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-09-20T23:08:33.758 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [mgr] 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: [osd] 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-09-20T23:08:33.759 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-09-20T23:08:34.396 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:34 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/73248369' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T23:08:34.396 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:34 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/73248369' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T23:08:34.396 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:34 smithi170 ceph-mon[23733]: mgrmap e4: y(active, since 2s) 2024-09-20T23:08:34.398 INFO:teuthology.orchestra.run.smithi170.stderr:Enabling cephadm module... 2024-09-20T23:08:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3225644885' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-20T23:08:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setuser ceph since I am not root 2024-09-20T23:08:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setgroup ceph since I am not root 2024-09-20T23:08:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:35.334+0000 7f18720ce000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:08:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:35.412+0000 7f18720ce000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:08:35.794 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:35.588+0000 7f18720ce000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:08:35.795 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:35.674+0000 7f18720ce000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:08:36.048 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:35.806+0000 7f18720ce000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:08:36.048 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:36.027+0000 7f18720ce000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:08:36.368 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3225644885' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-20T23:08:36.368 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-mon[23733]: mgrmap e5: y(active, since 4s) 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 5, 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "available": true, 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "active_name": "y", 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_standby": 0 2024-09-20T23:08:36.479 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:36.627 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:36.366+0000 7f18720ce000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:08:36.627 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:36.455+0000 7f18720ce000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:08:36.627 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:36.624+0000 7f18720ce000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:08:37.028 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for the mgr to restart... 2024-09-20T23:08:37.028 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mgr epoch 5... 2024-09-20T23:08:37.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:37 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1573860911' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T23:08:37.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:37.715+0000 7f18720ce000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:08:37.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:37.809+0000 7f18720ce000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:08:38.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:38.724+0000 7f18720ce000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:08:39.352 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.034+0000 7f18720ce000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:08:39.352 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.165+0000 7f18720ce000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:08:39.352 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.253+0000 7f18720ce000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:08:39.352 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.350+0000 7f18720ce000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:08:39.674 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.437+0000 7f18720ce000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:08:39.674 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.581+0000 7f18720ce000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:08:39.674 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.672+0000 7f18720ce000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:08:39.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:39.767+0000 7f18720ce000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:08:40.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:40.051+0000 7f18720ce000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:08:40.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:40.137+0000 7f18720ce000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:08:40.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:40.225+0000 7f18720ce000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:08:41.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:41 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:41.279+0000 7f18720ce000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:08:42.345 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:42.345 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-09-20T23:08:42.346 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "initialized": true 2024-09-20T23:08:42.346 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: Active manager daemon y restarted 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: Activating manager daemon y 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: osdmap e2: 0 total, 0 up, 0 in 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: mgrmap e6: y(active, starting, since 0.0527515s) 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: Manager daemon y is now available 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-mon[23733]: [20/Sep/2024:23:08:42] ENGINE Bus STARTING 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:08:42] ENGINE Bus STARTING 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:08:42] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:08:42.495 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:08:42] ENGINE Bus STARTED 2024-09-20T23:08:42.910 INFO:teuthology.orchestra.run.smithi170.stderr:mgr epoch 5 is available 2024-09-20T23:08:42.910 INFO:teuthology.orchestra.run.smithi170.stderr:Setting orchestrator backend to cephadm... 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: [20/Sep/2024:23:08:42] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: [20/Sep/2024:23:08:42] ENGINE Bus STARTED 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: mgrmap e7: y(active, since 1.05533s) 2024-09-20T23:08:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:43 smithi170 ceph-mon[23733]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T23:08:44.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:44 smithi170 ceph-mon[23733]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:44.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:44 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:44.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:44 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:44.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:44 smithi170 ceph-mon[23733]: mgrmap e8: y(active, since 2s) 2024-09-20T23:08:44.862 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: value unchanged 2024-09-20T23:08:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:Generating ssh key... 2024-09-20T23:08:45.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:45 smithi170 ceph-mon[23733]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:46.950 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-mon[23733]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:46.950 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-mon[23733]: Generating ssh key... 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: Generating public/private rsa key pair. 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: Your identification has been saved in /tmp/tmpd6cmvj6l/key. 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: Your public key has been saved in /tmp/tmpd6cmvj6l/key.pub. 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: The key fingerprint is: 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: SHA256:S+fIbu15/2bN3IhWUWnCUJibGxfb+9OaLiX0nHuv/hE ceph-243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: The key's randomart image is: 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: +---[RSA 3072]----+ 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | .*. .| 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | o + o.| 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | o *. | 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | +.o.. | 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | S ..+o E.| 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | o = .. *..| 2024-09-20T23:08:46.951 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | +.. = *=| 2024-09-20T23:08:46.952 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | .. ..= oo%| 2024-09-20T23:08:46.952 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: | ...oo =BO*| 2024-09-20T23:08:46.952 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: +----[SHA256]-----+ 2024-09-20T23:08:47.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:47 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:47.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:47 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:47.844 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYGEFCxZrpjitL8Jg5GIk6TBye6/0gLgnb487QGmlrz0ia7dKn1zHLMSl79Wa6EFh4kosfwJ0G4FmmYt/Xz6+iD8gR3W2o+paqGShXkTT0wcS9uQ+3FU4490AvQqB6jEb4k9hg81j4lpMP3YqHJh0P+oHBRvTZWIwZoKQG82MLDU9L6n5pUcbmAvYyIdRG1HmUhtNxWyTD5GFQ2ko+A5H1gDuuV1bHq5E3+uCPoM2+jvao9n7jpB/NWdQfzKQ+WujETrCGj9qKkSjVP9D6lM8PbGEcFF/j7DzY1/B0AKKnDml0qt/EtGeauy0S/p0oIDjbAmbKZYF7N1x4KzvfahoyZE66Ld3IGmZAwR/5v8H6yHjb0bgi4rA05g80QK5ZAfaFnMtfLLFYt2nuifsDn60goWvFDzfOz4nczAG012S+jDw7UorYU1bKh7YXeTKJN4RTJGfbkPxjYvyYzTJPgUV6rUGeXpZhJeIOBeLJc/ZPl+ozB9fqkSiL6+y756vlNCM= ceph-243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:08:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-20T23:08:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:Adding key to root@localhost authorized_keys... 2024-09-20T23:08:48.404 INFO:teuthology.orchestra.run.smithi170.stderr:Adding host smithi170... 2024-09-20T23:08:49.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:48 smithi170 ceph-mon[23733]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: Added host 'smithi170' with addr '172.21.15.170' 2024-09-20T23:08:50.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:49 smithi170 ceph-mon[23733]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "addr": "172.21.15.170", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:50.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:49 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:50.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:49 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:50.443 INFO:teuthology.orchestra.run.smithi170.stderr:Deploying unmanaged mon service... 2024-09-20T23:08:51.087 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: Scheduled mon update... 2024-09-20T23:08:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:50 smithi170 ceph-mon[23733]: Deploying cephadm binary to smithi170 2024-09-20T23:08:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:50 smithi170 ceph-mon[23733]: Added host smithi170 2024-09-20T23:08:51.818 INFO:teuthology.orchestra.run.smithi170.stderr:Deploying unmanaged mgr service... 2024-09-20T23:08:52.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:52 smithi170 ceph-mon[23733]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:52.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:52 smithi170 ceph-mon[23733]: Saving service mon spec with placement count:5 2024-09-20T23:08:52.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:52 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:52.515 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-09-20T23:08:53.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:53 smithi170 ceph-mon[23733]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:53.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:53 smithi170 ceph-mon[23733]: Saving service mgr spec with placement count:2 2024-09-20T23:08:53.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:53 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:55.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:54 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2165855011' entity='client.admin' 2024-09-20T23:08:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:55 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:55 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:55 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3723044918' entity='client.admin' 2024-09-20T23:08:56.698 INFO:teuthology.orchestra.run.smithi170.stderr:Enabling the dashboard module... 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: from='mgr.14118 172.21.15.170:0/279316434' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]': finished 2024-09-20T23:08:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:57 smithi170 ceph-mon[23733]: Deploying daemon agent.smithi170 on smithi170 2024-09-20T23:08:58.621 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3739051868' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-20T23:08:58.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setuser ceph since I am not root 2024-09-20T23:08:58.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setgroup ceph since I am not root 2024-09-20T23:08:58.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:58.517+0000 7f38ed8fa000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:08:58.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:58.594+0000 7f38ed8fa000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:08:58.978 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:58.772+0000 7f38ed8fa000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:08:58.978 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:58.859+0000 7f38ed8fa000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:08:59.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:58.991+0000 7f38ed8fa000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:08:59.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:59.202+0000 7f38ed8fa000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:08:59.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3739051868' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-20T23:08:59.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-mon[23733]: mgrmap e9: y(active, since 17s) 2024-09-20T23:08:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:08:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "epoch": 9, 2024-09-20T23:08:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "available": true, 2024-09-20T23:08:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "active_name": "y", 2024-09-20T23:08:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "num_standby": 0 2024-09-20T23:08:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:08:59.801 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:59.540+0000 7f38ed8fa000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:08:59.801 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:59.629+0000 7f38ed8fa000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:08:59.801 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:08:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:08:59.798+0000 7f38ed8fa000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:09:00.323 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for the mgr to restart... 2024-09-20T23:09:00.323 INFO:teuthology.orchestra.run.smithi170.stderr:Waiting for mgr epoch 9... 2024-09-20T23:09:00.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:00 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1993187228' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T23:09:01.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:00.874+0000 7f38ed8fa000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:09:01.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:00.966+0000 7f38ed8fa000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:09:02.179 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:01.865+0000 7f38ed8fa000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:09:02.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.177+0000 7f38ed8fa000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:09:02.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.311+0000 7f38ed8fa000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:09:02.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.399+0000 7f38ed8fa000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:09:02.828 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.497+0000 7f38ed8fa000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:09:02.829 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.586+0000 7f38ed8fa000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:09:02.829 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.733+0000 7f38ed8fa000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:09:02.829 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.826+0000 7f38ed8fa000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:09:03.211 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:02 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:02.922+0000 7f38ed8fa000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:09:03.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:03.209+0000 7f38ed8fa000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:09:03.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:03.296+0000 7f38ed8fa000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:09:03.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:03.385+0000 7f38ed8fa000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:09:04.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:09:04.452+0000 7f38ed8fa000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:09:05.193 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:09:04] ENGINE Bus STARTING 2024-09-20T23:09:05.193 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:09:04] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:09:05.194 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:09:04] ENGINE Bus STARTED 2024-09-20T23:09:05.518 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: { 2024-09-20T23:09:05.519 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-09-20T23:09:05.519 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: "initialized": true 2024-09-20T23:09:05.519 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: } 2024-09-20T23:09:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: Active manager daemon y restarted 2024-09-20T23:09:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: Activating manager daemon y 2024-09-20T23:09:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: osdmap e3: 0 total, 0 up, 0 in 2024-09-20T23:09:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: mgrmap e10: y(active, starting, since 0.0526614s) 2024-09-20T23:09:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: Manager daemon y is now available 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: [20/Sep/2024:23:09:04] ENGINE Bus STARTING 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: [20/Sep/2024:23:09:04] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: [20/Sep/2024:23:09:04] ENGINE Bus STARTED 2024-09-20T23:09:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:mgr epoch 9 is available 2024-09-20T23:09:06.141 INFO:teuthology.orchestra.run.smithi170.stderr:Generating a dashboard self-signed certificate... 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: mgrmap e11: y(active, since 1.05522s) 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:09:06.784 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: Self-signed certificate created 2024-09-20T23:09:07.447 INFO:teuthology.orchestra.run.smithi170.stderr:Creating initial admin user... 2024-09-20T23:09:07.840 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:07 smithi170 ceph-mon[23733]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:07.840 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:07.840 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:07.840 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:07 smithi170 ceph-mon[23733]: Deploying daemon agent.smithi170 on smithi170 2024-09-20T23:09:07.840 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:07 smithi170 ceph-mon[23733]: mgrmap e12: y(active, since 2s) 2024-09-20T23:09:08.280 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$tAaMP87oPHbI05rC/JquDul1RRjxnHL/z2deky/99ZGbgoaPDfS5C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726873748, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-20T23:09:08.913 INFO:teuthology.orchestra.run.smithi170.stderr:Fetching dashboard port number... 2024-09-20T23:09:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:09 smithi170 ceph-mon[23733]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:09.529 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: 8443 2024-09-20T23:09:10.230 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: disabled 2024-09-20T23:09:10.237 INFO:teuthology.orchestra.run.smithi170.stderr:systemctl: inactive 2024-09-20T23:09:10.237 INFO:teuthology.orchestra.run.smithi170.stderr:firewalld.service is not enabled 2024-09-20T23:09:10.237 INFO:teuthology.orchestra.run.smithi170.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:Ceph Dashboard is now available at: 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr: URL: https://smithi170.front.sepia.ceph.com:8443/ 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr: User: admin 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr: Password: k77vw4iyhs 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:Enabling autotune for osd_memory_target 2024-09-20T23:09:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:10 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3554391087' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-20T23:09:12.383 INFO:teuthology.orchestra.run.smithi170.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-09-20T23:09:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:12 smithi170 ceph-mon[23733]: mgrmap e13: y(active, since 6s) 2024-09-20T23:09:13.018 INFO:teuthology.orchestra.run.smithi170.stderr:You can access the Ceph CLI with: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr:Please consider enabling telemetry to help improve Ceph: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: ceph telemetry on 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr:For more information see: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-20T23:09:13.019 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:09:13.020 INFO:teuthology.orchestra.run.smithi170.stderr:Bootstrap complete. 2024-09-20T23:09:13.055 INFO:tasks.cephadm:Fetching config... 2024-09-20T23:09:13.055 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:13.055 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-20T23:09:13.071 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-20T23:09:13.071 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:13.071 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-20T23:09:13.128 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-20T23:09:13.128 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:13.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-20T23:09:13.230 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-20T23:09:13.230 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:13.231 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-20T23:09:13.286 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-20T23:09:13.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYGEFCxZrpjitL8Jg5GIk6TBye6/0gLgnb487QGmlrz0ia7dKn1zHLMSl79Wa6EFh4kosfwJ0G4FmmYt/Xz6+iD8gR3W2o+paqGShXkTT0wcS9uQ+3FU4490AvQqB6jEb4k9hg81j4lpMP3YqHJh0P+oHBRvTZWIwZoKQG82MLDU9L6n5pUcbmAvYyIdRG1HmUhtNxWyTD5GFQ2ko+A5H1gDuuV1bHq5E3+uCPoM2+jvao9n7jpB/NWdQfzKQ+WujETrCGj9qKkSjVP9D6lM8PbGEcFF/j7DzY1/B0AKKnDml0qt/EtGeauy0S/p0oIDjbAmbKZYF7N1x4KzvfahoyZE66Ld3IGmZAwR/5v8H6yHjb0bgi4rA05g80QK5ZAfaFnMtfLLFYt2nuifsDn60goWvFDzfOz4nczAG012S+jDw7UorYU1bKh7YXeTKJN4RTJGfbkPxjYvyYzTJPgUV6rUGeXpZhJeIOBeLJc/ZPl+ozB9fqkSiL6+y756vlNCM= ceph-243152d6-77a5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T23:09:13.430 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYGEFCxZrpjitL8Jg5GIk6TBye6/0gLgnb487QGmlrz0ia7dKn1zHLMSl79Wa6EFh4kosfwJ0G4FmmYt/Xz6+iD8gR3W2o+paqGShXkTT0wcS9uQ+3FU4490AvQqB6jEb4k9hg81j4lpMP3YqHJh0P+oHBRvTZWIwZoKQG82MLDU9L6n5pUcbmAvYyIdRG1HmUhtNxWyTD5GFQ2ko+A5H1gDuuV1bHq5E3+uCPoM2+jvao9n7jpB/NWdQfzKQ+WujETrCGj9qKkSjVP9D6lM8PbGEcFF/j7DzY1/B0AKKnDml0qt/EtGeauy0S/p0oIDjbAmbKZYF7N1x4KzvfahoyZE66Ld3IGmZAwR/5v8H6yHjb0bgi4rA05g80QK5ZAfaFnMtfLLFYt2nuifsDn60goWvFDzfOz4nczAG012S+jDw7UorYU1bKh7YXeTKJN4RTJGfbkPxjYvyYzTJPgUV6rUGeXpZhJeIOBeLJc/ZPl+ozB9fqkSiL6+y756vlNCM= ceph-243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:13.443 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYGEFCxZrpjitL8Jg5GIk6TBye6/0gLgnb487QGmlrz0ia7dKn1zHLMSl79Wa6EFh4kosfwJ0G4FmmYt/Xz6+iD8gR3W2o+paqGShXkTT0wcS9uQ+3FU4490AvQqB6jEb4k9hg81j4lpMP3YqHJh0P+oHBRvTZWIwZoKQG82MLDU9L6n5pUcbmAvYyIdRG1HmUhtNxWyTD5GFQ2ko+A5H1gDuuV1bHq5E3+uCPoM2+jvao9n7jpB/NWdQfzKQ+WujETrCGj9qKkSjVP9D6lM8PbGEcFF/j7DzY1/B0AKKnDml0qt/EtGeauy0S/p0oIDjbAmbKZYF7N1x4KzvfahoyZE66Ld3IGmZAwR/5v8H6yHjb0bgi4rA05g80QK5ZAfaFnMtfLLFYt2nuifsDn60goWvFDzfOz4nczAG012S+jDw7UorYU1bKh7YXeTKJN4RTJGfbkPxjYvyYzTJPgUV6rUGeXpZhJeIOBeLJc/ZPl+ozB9fqkSiL6+y756vlNCM= ceph-243152d6-77a5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T23:09:13.537 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYGEFCxZrpjitL8Jg5GIk6TBye6/0gLgnb487QGmlrz0ia7dKn1zHLMSl79Wa6EFh4kosfwJ0G4FmmYt/Xz6+iD8gR3W2o+paqGShXkTT0wcS9uQ+3FU4490AvQqB6jEb4k9hg81j4lpMP3YqHJh0P+oHBRvTZWIwZoKQG82MLDU9L6n5pUcbmAvYyIdRG1HmUhtNxWyTD5GFQ2ko+A5H1gDuuV1bHq5E3+uCPoM2+jvao9n7jpB/NWdQfzKQ+WujETrCGj9qKkSjVP9D6lM8PbGEcFF/j7DzY1/B0AKKnDml0qt/EtGeauy0S/p0oIDjbAmbKZYF7N1x4KzvfahoyZE66Ld3IGmZAwR/5v8H6yHjb0bgi4rA05g80QK5ZAfaFnMtfLLFYt2nuifsDn60goWvFDzfOz4nczAG012S+jDw7UorYU1bKh7YXeTKJN4RTJGfbkPxjYvyYzTJPgUV6rUGeXpZhJeIOBeLJc/ZPl+ozB9fqkSiL6+y756vlNCM= ceph-243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:13.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-20T23:09:13.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/607410506' entity='client.admin' 2024-09-20T23:09:14.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:15.194 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:14 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:16.985 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-20T23:09:16.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-20T23:09:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:17 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2012825359' entity='client.admin' 2024-09-20T23:09:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:20.189 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:19 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:20.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:21.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:21.435 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-09-20T23:09:21.435 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:09:21.435 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-09-20T23:09:21.453 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:09:21.454 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:21.512 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-09-20T23:09:21.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch host add smithi191 2024-09-20T23:09:22.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:21 smithi170 ceph-mon[23733]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:22.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:21 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:09:22.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:21 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:22.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:22.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:24.415 INFO:teuthology.orchestra.run.smithi170.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-09-20T23:09:24.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:24 smithi170 ceph-mon[23733]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:24.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:24 smithi170 ceph-mon[23733]: Deploying cephadm binary to smithi191 2024-09-20T23:09:24.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:25.086 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-20T23:09:25.700 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: Added host smithi191 2024-09-20T23:09:25.700 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:09:25.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]': finished 2024-09-20T23:09:26.954 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:09:26.954 INFO:teuthology.orchestra.run.smithi170.stdout:[{"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-09-20T23:09:27.619 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:27.641 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-20T23:09:27.641 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-20T23:09:28.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: Deploying daemon agent.smithi191 on smithi191 2024-09-20T23:09:28.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:28.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:09:28.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:28.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:28.240 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:28.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:29.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:29.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:30.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:adjusted tunables profile to default 2024-09-20T23:09:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:30 smithi170 ceph-mon[23733]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:30 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1210639823' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T23:09:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:31.127 INFO:tasks.cephadm:Adding mon.a on smithi170 2024-09-20T23:09:31.127 INFO:tasks.cephadm:Adding mon.c on smithi170 2024-09-20T23:09:31.128 INFO:tasks.cephadm:Adding mon.b on smithi191 2024-09-20T23:09:31.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi170:172.21.15.170=a;smithi170:[v2:172.21.15.170:3301,v1:172.21.15.170:6790]=c;smithi191:172.21.15.191=b' 2024-09-20T23:09:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:31 smithi170 ceph-mon[23733]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:31 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1210639823' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T23:09:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:31 smithi170 ceph-mon[23733]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:32.907 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-09-20T23:09:33.529 DEBUG:teuthology.orchestra.run.smithi170:mon.c> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service 2024-09-20T23:09:33.531 DEBUG:teuthology.orchestra.run.smithi191:mon.b> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b.service 2024-09-20T23:09:33.534 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T23:09:33.534 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T23:09:33.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:33.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi170:172.21.15.170=a;smithi170:[v2:172.21.15.170:3301,v1:172.21.15.170:6790]=c;smithi191:172.21.15.191=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:33.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: Saving service mon spec with placement smithi170:172.21.15.170=a;smithi170:[v2:172.21.15.170:3301,v1:172.21.15.170:6790]=c;smithi191:172.21.15.191=b;count:3 2024-09-20T23:09:33.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:33.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:33.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:33 smithi170 ceph-mon[23733]: Deploying daemon mon.c on smithi170 2024-09-20T23:09:35.396 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:09:35.396 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","modified":"2024-09-20T23:08:14.770981Z","created":"2024-09-20T23:08:14.770981Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T23:09:35.399 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-20T23:09:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:35 smithi170 ceph-mon[23733]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:35 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/1056268512' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:36.819 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:36 smithi170 podman[28602]: 2024-09-20 23:09:36.68570695 +0000 UTC m=+0.018948690 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-09-20T23:09:36.819 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:36 smithi170 podman[28602]: 2024-09-20 23:09:36.817233111 +0000 UTC m=+0.150474830 container create 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, release=754, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, version=8, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-09-20T23:09:37.029 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T23:09:37.030 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T23:09:37.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 podman[28602]: 2024-09-20 23:09:37.672672279 +0000 UTC m=+1.005914003 container init 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, distribution-scope=public, name=centos-stream, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, ceph=True, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-09-20T23:09:37.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 podman[28602]: 2024-09-20 23:09:37.676932817 +0000 UTC m=+1.010174547 container start 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, com.redhat.component=centos-stream-container, distribution-scope=public, vendor=Red Hat, Inc., ceph=True, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-09-20T23:09:37.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:09:37.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: pidfile_write: ignore empty --pid-file 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: load: jerasure load: lrc 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: RocksDB version: 6.15.5 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Compile date Apr 18 2022 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: DB SUMMARY 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: DB Session ID: JLTQW7A5F8EPJR1MACAX 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-20T23:09:37.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.env: 0x56121dcc6860 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.fs: Posix File System 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.info_log: 0x56121ebefdc0 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.statistics: (nil) 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.use_fsync: 0 2024-09-20T23:09:37.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.db_log_dir: 2024-09-20T23:09:37.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:09:37.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:09:37.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:09:37.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:09:37.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.write_buffer_manager: 0x56121ece0270 2024-09-20T23:09:37.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.unordered_write: 0 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:09:37.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.row_cache: None 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.wal_filter: None 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.preserve_deletes: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:09:37.963 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:09:37.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_open_files: -1 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Compression algorithms supported: 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kZSTD supported: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:09:37.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.merge_operator: 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_filter: None 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56121ebbbd00) 2024-09-20T23:09:37.966 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_type: 0 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_shortening: 1 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: hash_index_allow_collision: 1 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: checksum: 1 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: no_block_cache: 0 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache: 0x56121ec26170 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_options: 2024-09-20T23:09:37.967 INFO:journalctl@ceph.mon.c.smithi170.stdout: capacity : 536870912 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size: 4096 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: partition_filters: 0 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-20T23:09:37.968 INFO:journalctl@ceph.mon.c.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout: verify_compression: 0 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout: format_version: 4 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_align: 0 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression: NoCompression 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.num_levels: 7 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:09:37.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:09:37.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:09:37.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.arena_block_size: 4194304 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:09:37.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:09:37.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:09:37.974 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:09:37.974 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:09:37.974 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.table_properties_collectors: 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:09:37.975 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.ttl: 2592000 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873777702494, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873777702791, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726873777, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "6fc25ff4-d06c-47f9-8fea-d847d369509e", "db_session_id": "JLTQW7A5F8EPJR1MACAX"}} 2024-09-20T23:09:37.976 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726873777703115, "job": 1, "event": "recovery_finished"} 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x56121ec0ca80 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: DB pointer 0x56121ec1c000 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** DB Stats ** 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:09:37.977 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:09:37.978 INFO:journalctl@ceph.mon.c.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:09:37.979 INFO:journalctl@ceph.mon.c.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.2 0.00 0.00 1 0.000 0 0 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:09:37.980 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: using public_addrv [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: starting mon.c rank -1 at public addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] at bind addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(???) e0 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).mds e1 new map 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-20T23:09:37.981 INFO:journalctl@ceph.mon.c.smithi170.stdout: e1 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout: No filesystems configured 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T23:09:37.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/1056268512' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 ceph-mon[28691]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 bash[28602]: 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad 2024-09-20T23:09:37.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:37 smithi170 systemd[1]: Started Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:09:43.196 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:09:43.196 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","modified":"2024-09-20T23:09:37.721287Z","created":"2024-09-20T23:08:14.770981Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3301","nonce":0},{"type":"v1","addr":"172.21.15.170:6790","nonce":0}]},"addr":"172.21.15.170:6790/0","public_addr":"172.21.15.170:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T23:09:43.198 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-20T23:09:43.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: mon.a calling monitor election 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: mon.c calling monitor election 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: monmap e2: 2 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: fsmap 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: mgrmap e13: y(active, since 38s) 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: overall HEALTH_OK 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: mon.a calling monitor election 2024-09-20T23:09:43.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: mon.c calling monitor election 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: monmap e2: 2 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: fsmap 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: mgrmap e13: y(active, since 38s) 2024-09-20T23:09:43.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:09:43.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:43.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:43.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:43.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:43.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[23733]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[23733]: Deploying daemon mon.b on smithi191 2024-09-20T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/3922230132' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[28691]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[28691]: Deploying daemon mon.b on smithi191 2024-09-20T23:09:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/3922230132' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:44.825 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T23:09:44.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T23:09:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:45 smithi170 ceph-mon[23733]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:45 smithi170 ceph-mon[28691]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:47.775 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:09:47.775 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","modified":"2024-09-20T23:09:37.721287Z","created":"2024-09-20T23:08:14.770981Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3301","nonce":0},{"type":"v1","addr":"172.21.15.170:6790","nonce":0}]},"addr":"172.21.15.170:6790/0","public_addr":"172.21.15.170:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T23:09:47.776 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-20T23:09:49.829 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T23:09:49.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T23:09:53.230 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:52 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:53.230 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: mon.a calling monitor election 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: mon.c calling monitor election 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: fsmap 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: mgrmap e13: y(active, since 48s) 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: mon.b (rank 2) addr [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] is down (out of quorum) 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:53.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: mon.a calling monitor election 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: mon.c calling monitor election 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: fsmap 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: mgrmap e13: y(active, since 48s) 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: mon.b (rank 2) addr [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] is down (out of quorum) 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:53.235 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:53.235 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:53.235 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:09:53.612 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","modified":"2024-09-20T23:09:47.954986Z","created":"2024-09-20T23:08:14.770981Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3301","nonce":0},{"type":"v1","addr":"172.21.15.170:6790","nonce":0}]},"addr":"172.21.15.170:6790/0","public_addr":"172.21.15.170:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T23:09:53.613 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:09:54.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: Reconfiguring mon.a (unknown last config time)... 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: Reconfiguring daemon mon.a on smithi170 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/792854685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: Reconfiguring mon.a (unknown last config time)... 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: Reconfiguring daemon mon.a on smithi170 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/792854685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T23:09:54.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:54.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:55.217 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:55.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:54 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:55.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:09:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:55.574 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-20T23:09:55.574 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-20T23:09:56.071 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mon.b calling monitor election 2024-09-20T23:09:56.071 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mon.b calling monitor election 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mon.c calling monitor election 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mon.a calling monitor election 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: fsmap 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: mgrmap e13: y(active, since 50s) 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: Cluster is now healthy 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:09:56.072 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mon.b calling monitor election 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mon.b calling monitor election 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mon.c calling monitor election 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mon.a calling monitor election 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: fsmap 2024-09-20T23:09:56.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: mgrmap e13: y(active, since 50s) 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: Cluster is now healthy 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: overall HEALTH_OK 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:55 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.219 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mon.b calling monitor election 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mon.b calling monitor election 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mon.c calling monitor election 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mon.a calling monitor election 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0]} 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: fsmap 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: mgrmap e13: y(active, since 50s) 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:09:56.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: Cluster is now healthy 2024-09-20T23:09:56.221 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:09:56.221 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.221 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:55 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:09:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:56.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:57.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:09:57.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:57.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:58.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:58 smithi191 ceph-mon[24760]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:58.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:58.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:58.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:09:58.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[23733]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[28691]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:09:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:09:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:58.977 INFO:teuthology.orchestra.run.smithi170.stdout:# minimal ceph.conf for 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:58.978 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-09-20T23:09:58.978 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:09:58.978 INFO:teuthology.orchestra.run.smithi170.stdout: mon_host = [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: Reconfiguring mon.b (monmap changed)... 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: Reconfiguring daemon mon.b on smithi191 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/676874756' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:59.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: Reconfiguring mon.b (monmap changed)... 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: Reconfiguring daemon mon.b on smithi191 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/676874756' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:59.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:09:59 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.698 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-20T23:09:59.698 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:59.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T23:09:59.727 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:09:59.727 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: Reconfiguring mon.b (monmap changed)... 2024-09-20T23:09:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: Reconfiguring daemon mon.b on smithi191 2024-09-20T23:09:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/676874756' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:09:59 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:09:59.792 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:09:59.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T23:09:59.824 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:09:59.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:09:59.892 INFO:tasks.cephadm:Adding mgr.y on smithi170 2024-09-20T23:09:59.892 INFO:tasks.cephadm:Adding mgr.x on smithi191 2024-09-20T23:09:59.893 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply mgr '2;smithi170=y;smithi191=x' 2024-09-20T23:10:00.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:10:00] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[28691]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[23733]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[23733]: overall HEALTH_OK 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:00.539 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:00 smithi191 ceph-mon[24760]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:00.539 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:00 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:10:00.539 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:00.539 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:01.893 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-09-20T23:10:02.409 DEBUG:teuthology.orchestra.run.smithi191:mgr.x> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service 2024-09-20T23:10:02.411 INFO:tasks.cephadm:Deploying OSDs... 2024-09-20T23:10:02.412 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:10:02.412 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T23:10:02.431 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T23:10:02.432 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:02.490 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-20 23:09:58.845803404 +0000 2024-09-20T23:10:02.491 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-20 23:07:22.325926033 +0000 2024-09-20T23:10:02.491 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-20 23:07:22.325926033 +0000 2024-09-20T23:10:02.491 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-20 23:07:22.325926033 +0000 2024-09-20T23:10:02.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T23:10:02.557 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-20T23:10:02.557 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-20T23:10:02.557 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.8646e-05 s, 5.2 MB/s 2024-09-20T23:10:02.559 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T23:10:02.614 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:02.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.617 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-09-20T23:10:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T23:10:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-20 23:09:58.845803404 +0000 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-20 23:07:22.626918419 +0000 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-20 23:07:22.626918419 +0000 2024-09-20T23:10:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-20 23:07:22.626918419 +0000 2024-09-20T23:10:02.675 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T23:10:02.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:02.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:02.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-20T23:10:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-20T23:10:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.00011395 s, 4.5 MB/s 2024-09-20T23:10:02.742 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T23:10:02.800 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-09-20T23:10:02.857 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T23:10:02.857 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:02.857 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-20T23:10:02.857 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:02.857 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:02.858 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-20 23:09:58.845803404 +0000 2024-09-20T23:10:02.858 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-20 23:07:22.934910628 +0000 2024-09-20T23:10:02.858 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-20 23:07:22.934910628 +0000 2024-09-20T23:10:02.858 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-20 23:07:22.934910628 +0000 2024-09-20T23:10:02.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T23:10:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-20T23:10:02.923 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-20T23:10:02.923 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.7707e-05 s, 5.2 MB/s 2024-09-20T23:10:02.924 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T23:10:02.981 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-20 23:09:58.845803404 +0000 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-20 23:07:23.242902836 +0000 2024-09-20T23:10:03.038 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-20 23:07:23.242902836 +0000 2024-09-20T23:10:03.039 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-20 23:07:23.242902836 +0000 2024-09-20T23:10:03.039 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T23:10:03.102 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-20T23:10:03.102 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-20T23:10:03.102 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000116879 s, 4.4 MB/s 2024-09-20T23:10:03.103 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T23:10:03.160 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:10:03.160 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T23:10:03.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T23:10:03.176 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-20 23:09:55.559016663 +0000 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-20 23:07:22.336008331 +0000 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-20 23:07:22.336008331 +0000 2024-09-20T23:10:03.232 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-20 23:07:22.336008331 +0000 2024-09-20T23:10:03.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T23:10:03.296 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-20T23:10:03.296 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-20T23:10:03.296 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000212623 s, 2.4 MB/s 2024-09-20T23:10:03.297 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T23:10:03.354 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-09-20T23:10:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T23:10:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:03.410 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-20T23:10:03.410 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:03.410 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:03.411 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-20 23:09:55.559016663 +0000 2024-09-20T23:10:03.411 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-20 23:07:22.675002062 +0000 2024-09-20T23:10:03.411 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-20 23:07:22.675002062 +0000 2024-09-20T23:10:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-20 23:07:22.675002062 +0000 2024-09-20T23:10:03.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T23:10:03.474 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-20T23:10:03.474 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-20T23:10:03.474 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000238947 s, 2.1 MB/s 2024-09-20T23:10:03.475 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T23:10:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[23733]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi170=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[23733]: Saving service mgr spec with placement smithi170=y;smithi191=x;count:2 2024-09-20T23:10:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[23733]: Deploying daemon mgr.x on smithi191 2024-09-20T23:10:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[28691]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi170=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[28691]: Saving service mgr spec with placement smithi170=y;smithi191=x;count:2 2024-09-20T23:10:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:03 smithi170 ceph-mon[28691]: Deploying daemon mgr.x on smithi191 2024-09-20T23:10:03.532 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-09-20T23:10:03.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:03 smithi191 ceph-mon[24760]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi170=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:03.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:03 smithi191 ceph-mon[24760]: Saving service mgr spec with placement smithi170=y;smithi191=x;count:2 2024-09-20T23:10:03.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:03 smithi191 ceph-mon[24760]: Deploying daemon mgr.x on smithi191 2024-09-20T23:10:03.587 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-20 23:09:55.559016663 +0000 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-20 23:07:23.012995811 +0000 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-20 23:07:23.012995811 +0000 2024-09-20T23:10:03.588 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-20 23:07:23.012995811 +0000 2024-09-20T23:10:03.588 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T23:10:03.666 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-20T23:10:03.666 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-20T23:10:03.666 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000180256 s, 2.8 MB/s 2024-09-20T23:10:03.667 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T23:10:03.730 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-09-20T23:10:03.785 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-20 23:10:03.618878396 +0000 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-20 23:07:23.321990096 +0000 2024-09-20T23:10:03.837 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-20 23:07:23.321990096 +0000 2024-09-20T23:10:03.838 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-20 23:07:23.321990096 +0000 2024-09-20T23:10:03.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T23:10:03.862 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-20T23:10:03.863 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-20T23:10:03.863 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000189957 s, 2.7 MB/s 2024-09-20T23:10:03.864 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T23:10:03.922 INFO:tasks.cephadm:Deploying osd.0 on smithi170 with /dev/vg_nvme/lv_4... 2024-09-20T23:10:03.922 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T23:10:04.468 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-mon[24760]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:04.468 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 systemd[1]: Started Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:10:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:04 smithi170 ceph-mon[23733]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:04.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:04 smithi170 ceph-mon[28691]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:04.721 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:04.464+0000 7fb94ae21000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:10:04.722 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:04.544+0000 7fb94ae21000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:10:04.722 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:04.718+0000 7fb94ae21000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:10:04.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:04.806+0000 7fb94ae21000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:10:04.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:04.942+0000 7fb94ae21000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:10:05.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:05.155+0000 7fb94ae21000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: Reconfiguring mgr.y (unknown last config time)... 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: Reconfiguring mgr.y (unknown last config time)... 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:10:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.754 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:05.491+0000 7fb94ae21000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:10:05.754 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:05.586+0000 7fb94ae21000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:05.751+0000 7fb94ae21000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: Reconfiguring mgr.y (unknown last config time)... 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:10:05.755 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:05.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:10:05.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:05.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:10:05.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:10:05.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:06.889+0000 7fb94ae21000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:10:07.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:06.988+0000 7fb94ae21000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:10:07.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:07.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:07.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:07.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:07.556 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.556 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:07.556 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:07.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:10:07.561 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:10:07.580 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-09-20T23:10:08.184 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:10:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:08.184 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:10:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:08.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:07.932+0000 7fb94ae21000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:08.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.561 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:08.561 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.561 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.244+0000 7fb94ae21000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.375+0000 7fb94ae21000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.462+0000 7fb94ae21000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:10:08.562 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.558+0000 7fb94ae21000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:10:08.886 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.646+0000 7fb94ae21000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:10:08.886 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.791+0000 7fb94ae21000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:10:08.886 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.883+0000 7fb94ae21000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:10:09.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:08.978+0000 7fb94ae21000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:10:09.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:09 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:09.264+0000 7fb94ae21000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:10:09.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:09 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:09.354+0000 7fb94ae21000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:10:09.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:09 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:09.440+0000 7fb94ae21000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:10:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[23733]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[28691]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:10 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:10.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:10 smithi191 ceph-mon[24760]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:10 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:10 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:10 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:10.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:10:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:10:10.496+0000 7fb94ae21000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: Standby manager daemon x started 2024-09-20T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: Standby manager daemon x started 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:10:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: Standby manager daemon x started 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:10:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1526509833' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:10:12.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: mgrmap e14: y(active, since 66s), standbys: x 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2104390703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]': finished 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: osdmap e5: 1 total, 0 up, 1 in 2024-09-20T23:10:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: mgrmap e14: y(active, since 66s), standbys: x 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2104390703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]': finished 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: osdmap e5: 1 total, 0 up, 1 in 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: mgrmap e14: y(active, since 66s), standbys: x 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2104390703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]: dispatch 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3ce0997-6af3-4134-8516-f7e91b087e8f"}]': finished 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: osdmap e5: 1 total, 0 up, 1 in 2024-09-20T23:10:12.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1742137299' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1742137299' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:13.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1742137299' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:14 smithi191 ceph-mon[24760]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:14.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:14 smithi170 ceph-mon[23733]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:14.600 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:14 smithi170 ceph-mon[28691]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:16 smithi170 ceph-mon[23733]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:16 smithi170 ceph-mon[28691]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:16.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:16 smithi191 ceph-mon[24760]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:18.534 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:18 smithi170 ceph-mon[23733]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:18.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:18 smithi170 ceph-mon[28691]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:18.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:18 smithi191 ceph-mon[24760]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:20.577 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[23733]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:20.577 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:10:20.577 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:20.578 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:10:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:20.578 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[28691]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:20.578 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:10:20.578 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:20 smithi191 ceph-mon[24760]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:10:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:21.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[23733]: Deploying daemon osd.0 on smithi170 2024-09-20T23:10:21.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:21.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi170 2024-09-20T23:10:21.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:21.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[28691]: Deploying daemon osd.0 on smithi170 2024-09-20T23:10:21.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:21.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi170 2024-09-20T23:10:21.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:21 smithi191 ceph-mon[24760]: Deploying daemon osd.0 on smithi170 2024-09-20T23:10:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:21 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi170 2024-09-20T23:10:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:22.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:22 smithi170 ceph-mon[23733]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:22.491 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:22 smithi170 ceph-mon[28691]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:22.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:22 smithi191 ceph-mon[24760]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:24.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:24 smithi170 ceph-mon[23733]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:24.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:24 smithi170 ceph-mon[28691]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:24 smithi191 ceph-mon[24760]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:26.217 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:26.498 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:10:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:27.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:27 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:27.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:27 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:27.594 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:27 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:27.594 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:27 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:27.626 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 0 on host 'smithi170' 2024-09-20T23:10:27.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:27 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:27.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:27 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.280 DEBUG:teuthology.orchestra.run.smithi170:osd.0> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service 2024-09-20T23:10:28.282 INFO:tasks.cephadm:Deploying osd.1 on smithi170 with /dev/vg_nvme/lv_3... 2024-09-20T23:10:28.282 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.620 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[23733]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:28 smithi170 ceph-mon[28691]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:10:28.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:28 smithi191 ceph-mon[24760]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi170 to 15040M 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[28691]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[28691]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[28691]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:29.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi170 to 15040M 2024-09-20T23:10:29.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[23733]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:10:29.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[23733]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T23:10:29.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:29.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:29 smithi170 ceph-mon[23733]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:29.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:29 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi170 to 15040M 2024-09-20T23:10:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:29 smithi191 ceph-mon[24760]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:10:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:29 smithi191 ceph-mon[24760]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T23:10:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:29 smithi191 ceph-mon[24760]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:30.244 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[31946]: 2024-09-20T23:10:30.007+0000 7faf25157700 -1 osd.0 0 waiting for initial osdmap 2024-09-20T23:10:30.244 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[31946]: 2024-09-20T23:10:30.009+0000 7faf1faee700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[23733]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[23733]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[23733]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:30.696 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[28691]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:30.697 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[28691]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:30.697 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[28691]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T23:10:30.697 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:30.697 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:30 smithi191 ceph-mon[24760]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:30 smithi191 ceph-mon[24760]: from='osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:30 smithi191 ceph-mon[24760]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T23:10:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:31.009 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:10:31.033 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-09-20T23:10:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:10:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:10:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870] boot 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: osdmap e8: 1 total, 1 up, 1 in 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870] boot 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: osdmap e8: 1 total, 1 up, 1 in 2024-09-20T23:10:32.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:32 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: osd.0 [v2:172.21.15.170:6802/3598562870,v1:172.21.15.170:6803/3598562870] boot 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: osdmap e8: 1 total, 1 up, 1 in 2024-09-20T23:10:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:32 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:10:33.238 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[23733]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T23:10:33.238 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:33.238 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:33.238 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:33.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[28691]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T23:10:33.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:33.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:33.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:33 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:33 smithi191 ceph-mon[24760]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T23:10:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:33 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:33 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:33 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:34.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:34 smithi170 ceph-mon[23733]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:34.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:34 smithi170 ceph-mon[23733]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:34.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:34 smithi170 ceph-mon[28691]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:34.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:34 smithi170 ceph-mon[28691]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:34 smithi191 ceph-mon[24760]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:34 smithi191 ceph-mon[24760]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]: dispatch 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]': finished 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: osdmap e10: 2 total, 1 up, 2 in 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1773044138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]: dispatch 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]': finished 2024-09-20T23:10:36.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: osdmap e10: 2 total, 1 up, 2 in 2024-09-20T23:10:36.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:36.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:36 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1773044138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]: dispatch 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1881229951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0"}]': finished 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: osdmap e10: 2 total, 1 up, 2 in 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:36 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1773044138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:10:37.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:10:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[23733]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[28691]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:38 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:38 smithi191 ceph-mon[24760]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:38 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:38 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:40 smithi170 ceph-mon[23733]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:40.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:40 smithi170 ceph-mon[28691]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:40 smithi191 ceph-mon[24760]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:42 smithi170 ceph-mon[28691]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:42 smithi170 ceph-mon[23733]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:42.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:42 smithi191 ceph-mon[24760]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[23733]: Deploying daemon osd.1 on smithi170 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:43.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:43 smithi170 ceph-mon[28691]: Deploying daemon osd.1 on smithi170 2024-09-20T23:10:43.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:43 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:10:43.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:43 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:43.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:43 smithi191 ceph-mon[24760]: Deploying daemon osd.1 on smithi170 2024-09-20T23:10:44.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:44 smithi191 ceph-mon[24760]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:44 smithi170 ceph-mon[23733]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:44 smithi170 ceph-mon[28691]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:46.344 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:46 smithi170 ceph-mon[23733]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:46.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:46 smithi170 ceph-mon[28691]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:46.453 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:46 smithi191 ceph-mon[24760]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:46.611 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:10:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:50.152 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 1 on host 'smithi170' 2024-09-20T23:10:50.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:50 smithi170 ceph-mon[23733]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:50.307 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:50 smithi170 ceph-mon[28691]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:50.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:50 smithi191 ceph-mon[24760]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:50.797 DEBUG:teuthology.orchestra.run.smithi170:osd.1> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service 2024-09-20T23:10:50.799 INFO:tasks.cephadm:Deploying osd.2 on smithi170 with /dev/vg_nvme/lv_2... 2024-09-20T23:10:50.799 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T23:10:51.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:51.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi170 to 7520M 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[23733]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:51.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi170 to 7520M 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:51.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:51 smithi170 ceph-mon[28691]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi170 to 7520M 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:51 smithi191 ceph-mon[24760]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:10:52.353 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[28691]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:10:52.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T23:10:52.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:52.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:52.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-mon[23733]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:52.355 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[34823]: 2024-09-20T23:10:52.188+0000 7fad1879b700 -1 osd.1 0 waiting for initial osdmap 2024-09-20T23:10:52.355 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:10:52 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[34823]: 2024-09-20T23:10:52.190+0000 7fad15136700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:10:52.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:10:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T23:10:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: from='osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:52 smithi191 ceph-mon[24760]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:10:53.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[23733]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[23733]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[28691]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[28691]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:53.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:53.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:10:53.451 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-09-20T23:10:53.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:53 smithi191 ceph-mon[24760]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:10:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:53 smithi191 ceph-mon[24760]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T23:10:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034] boot 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: osdmap e13: 2 total, 2 up, 2 in 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:10:54.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:10:54.415 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:54.415 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034] boot 2024-09-20T23:10:54.415 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: osdmap e13: 2 total, 2 up, 2 in 2024-09-20T23:10:54.415 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:10:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:10:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-20T23:10:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: osd.1 [v2:172.21.15.170:6810/81196034,v1:172.21.15.170:6811/81196034] boot 2024-09-20T23:10:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: osdmap e13: 2 total, 2 up, 2 in 2024-09-20T23:10:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:54 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:10:55.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:55 smithi170 ceph-mon[23733]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T23:10:55.376 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:55 smithi170 ceph-mon[28691]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T23:10:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:55 smithi191 ceph-mon[24760]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T23:10:56.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:56 smithi191 ceph-mon[24760]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:56 smithi191 ceph-mon[24760]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[23733]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[23733]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[28691]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[28691]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:10:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:57.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:10:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:10:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi170 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.605 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi170 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.606 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:58 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi170 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:10:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:58 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:10:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:10:59 smithi170 ceph-mon[23733]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:10:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:10:59 smithi170 ceph-mon[28691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:10:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:10:59 smithi191 ceph-mon[24760]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]: dispatch 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]': finished 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: osdmap e15: 3 total, 2 up, 3 in 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]: dispatch 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]': finished 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: osdmap e15: 3 total, 2 up, 3 in 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.744 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:11:00] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]: dispatch 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3552449341' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b49c0282-93c6-46d2-ba8a-2767884b07c6"}]': finished 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: osdmap e15: 3 total, 2 up, 3 in 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:00.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:01 smithi191 ceph-mon[24760]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:01 smithi191 ceph-mon[24760]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:01 smithi191 ceph-mon[24760]: Cluster is now healthy 2024-09-20T23:11:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:01 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/397640912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[23733]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[23733]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[23733]: Cluster is now healthy 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/397640912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[28691]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[28691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[28691]: Cluster is now healthy 2024-09-20T23:11:01.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:01 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/397640912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:03.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:03 smithi170 ceph-mon[23733]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:03.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:03 smithi170 ceph-mon[28691]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:03 smithi191 ceph-mon[24760]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:05.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[23733]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:05.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:11:05.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:11:05.531 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[28691]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:05.531 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:11:05.531 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:11:05.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:05 smithi191 ceph-mon[24760]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:11:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:11:06.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:11:06.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:06.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:06 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:11:06.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:06 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:06.651 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:06 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:11:06.651 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:06 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:06.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:11:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:07.684 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:07 smithi191 ceph-mon[24760]: Deploying daemon osd.2 on smithi170 2024-09-20T23:11:07.684 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:07 smithi191 ceph-mon[24760]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:07.684 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:07.684 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:07.689 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[23733]: Deploying daemon osd.2 on smithi170 2024-09-20T23:11:07.689 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[23733]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:07.689 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:07.689 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:07.690 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[28691]: Deploying daemon osd.2 on smithi170 2024-09-20T23:11:07.690 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[28691]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:07.690 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:07.690 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:09.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:09 smithi170 ceph-mon[23733]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:09.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:09 smithi170 ceph-mon[28691]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:09.220 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:09 smithi191 ceph-mon[24760]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:11.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:11 smithi191 ceph-mon[24760]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:11.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:11 smithi170 ceph-mon[23733]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:11 smithi170 ceph-mon[28691]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:12.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:12 smithi191 ceph-mon[24760]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[23733]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:12.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:12.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:12.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:12.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:12 smithi170 ceph-mon[28691]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:14.179 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 2 on host 'smithi170' 2024-09-20T23:11:14.808 DEBUG:teuthology.orchestra.run.smithi170:osd.2> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service 2024-09-20T23:11:14.810 INFO:tasks.cephadm:Deploying osd.3 on smithi170 with /dev/vg_nvme/lv_1... 2024-09-20T23:11:14.810 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi170 to 5013M 2024-09-20T23:11:15.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:15.431 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:15 smithi191 ceph-mon[24760]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi170 to 5013M 2024-09-20T23:11:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[23733]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi170 to 5013M 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:15.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:15.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:15 smithi170 ceph-mon[28691]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:11:16.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[23733]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:11:16.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[23733]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T23:11:16.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:16.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[23733]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:16.363 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[28691]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:11:16.364 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[28691]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T23:11:16.364 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:16.364 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-mon[28691]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:16.364 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[37738]: 2024-09-20T23:11:16.227+0000 7fc4d6832700 -1 osd.2 0 waiting for initial osdmap 2024-09-20T23:11:16.364 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:16 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[37738]: 2024-09-20T23:11:16.230+0000 7fc4d21cb700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:11:16.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:16 smithi191 ceph-mon[24760]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:11:16.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:16 smithi191 ceph-mon[24760]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T23:11:16.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:16 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:16.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:16 smithi191 ceph-mon[24760]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[28691]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[28691]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T23:11:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[28691]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[23733]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[23733]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:17 smithi170 ceph-mon[23733]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:17 smithi191 ceph-mon[24760]: from='osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:17 smithi191 ceph-mon[24760]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T23:11:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:17 smithi191 ceph-mon[24760]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-20T23:11:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:11:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:11:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[28691]: osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567] boot 2024-09-20T23:11:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[28691]: osdmap e18: 3 total, 3 up, 3 in 2024-09-20T23:11:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:11:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:11:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[23733]: osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567] boot 2024-09-20T23:11:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[23733]: osdmap e18: 3 total, 3 up, 3 in 2024-09-20T23:11:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:18 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:11:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:18 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:11:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:18 smithi191 ceph-mon[24760]: osd.2 [v2:172.21.15.170:6818/2504239567,v1:172.21.15.170:6819/2504239567] boot 2024-09-20T23:11:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:18 smithi191 ceph-mon[24760]: osdmap e18: 3 total, 3 up, 3 in 2024-09-20T23:11:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:11:19.406 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[23733]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T23:11:19.406 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[23733]: pgmap v77: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:19.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-20T23:11:19.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[28691]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T23:11:19.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[28691]: pgmap v77: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:19.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-20T23:11:19.670 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:11:19.689 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi170:vg_nvme/lv_1 2024-09-20T23:11:19.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:19 smithi191 ceph-mon[24760]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T23:11:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:19 smithi191 ceph-mon[24760]: pgmap v77: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-20T23:11:20.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[23733]: osdmap e20: 3 total, 3 up, 3 in 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:11:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[28691]: osdmap e20: 3 total, 3 up, 3 in 2024-09-20T23:11:20.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T23:11:20.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-20T23:11:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:20 smithi191 ceph-mon[24760]: osdmap e20: 3 total, 3 up, 3 in 2024-09-20T23:11:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T23:11:21.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38950]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:21.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38950]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:21.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38950]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:21.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T23:11:21.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: osdmap e21: 3 total, 3 up, 3 in 2024-09-20T23:11:21.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi170 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: osdmap e21: 3 total, 3 up, 3 in 2024-09-20T23:11:21.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi170 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.695 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38970]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:21.695 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38970]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:21.695 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38970]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: osdmap e21: 3 total, 3 up, 3 in 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi170 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:21.967 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38979]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:21.967 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38979]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:21.967 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[38979]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:22.234 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:11:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:22.234 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[39019]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:22.234 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[39019]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:22.234 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:11:21 smithi170 sudo[39019]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:22.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39137]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:22.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39137]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:22.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39137]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:22.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:11:22.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: osdmap e22: 3 total, 3 up, 3 in 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:11:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: osdmap e22: 3 total, 3 up, 3 in 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: osdmap e22: 3 total, 3 up, 3 in 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:22.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:22.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:22 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:22.750 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39180]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:22.750 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39180]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:22.750 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39180]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:23.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39201]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:23.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39201]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:23.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:22 smithi170 sudo[39201]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:23.256 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39204]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:23.256 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39204]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:23.257 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39204]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:23.514 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39211]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:23.514 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39211]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:23.514 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39211]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:23.820 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39233]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:23.820 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39233]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:23.820 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:23 smithi170 sudo[39233]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:24.007 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:23 smithi191 sudo[27190]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T23:11:24.007 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:23 smithi191 sudo[27190]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:24.008 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:23 smithi191 sudo[27190]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:24.008 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 sudo[27193]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T23:11:24.008 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 sudo[27193]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-20T23:11:24.008 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 sudo[27193]: pam_unix(sudo:session): session closed for user root 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[28691]: Cluster is now healthy 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:24.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:24 smithi170 ceph-mon[23733]: Cluster is now healthy 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:24.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:24.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:24.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-20T23:11:24.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:24 smithi191 ceph-mon[24760]: Cluster is now healthy 2024-09-20T23:11:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]: dispatch 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]': finished 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T23:11:25.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]: dispatch 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]': finished 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T23:11:25.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]: dispatch 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/289304620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f02cfafe-5ac9-48ce-90c2-65b02b4efc82"}]': finished 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T23:11:25.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:26.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:26 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1247906560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:26 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1247906560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:26 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1247906560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:26.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:11:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:27.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[23733]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:27.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:27.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:27.299 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[28691]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:27.299 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:27.299 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:27 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:27.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:27 smithi191 ceph-mon[24760]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:27.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:27 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:27.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:27 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:29.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:29 smithi170 ceph-mon[23733]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:29.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:29 smithi170 ceph-mon[28691]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:29.322 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:29 smithi191 ceph-mon[24760]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:31 smithi191 ceph-mon[24760]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:11:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[23733]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:11:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:31.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[28691]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:11:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:32.387 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:32 smithi170 ceph-mon[23733]: Deploying daemon osd.3 on smithi170 2024-09-20T23:11:32.388 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:32 smithi170 ceph-mon[28691]: Deploying daemon osd.3 on smithi170 2024-09-20T23:11:32.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:32 smithi191 ceph-mon[24760]: Deploying daemon osd.3 on smithi170 2024-09-20T23:11:33.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:33 smithi170 ceph-mon[23733]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:33.581 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:33 smithi170 ceph-mon[28691]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:33.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:33 smithi191 ceph-mon[24760]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:35 smithi170 ceph-mon[28691]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:35 smithi170 ceph-mon[23733]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:35.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:35 smithi191 ceph-mon[24760]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:37.539 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:37.540 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:37 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:37 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:39.228 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:39 smithi170 ceph-mon[28691]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:39.229 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:39 smithi170 ceph-mon[23733]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:39 smithi191 ceph-mon[24760]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:40.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:40 smithi170 ceph-mon[23733]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:11:40.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:40 smithi170 ceph-mon[28691]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:11:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:40 smithi191 ceph-mon[24760]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:11:40.955 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 3 on host 'smithi170' 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T23:11:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:41 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:11:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:41 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:41.656 DEBUG:teuthology.orchestra.run.smithi170:osd.3> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.3.service 2024-09-20T23:11:41.659 INFO:tasks.cephadm:Deploying osd.4 on smithi191 with /dev/vg_nvme/lv_4... 2024-09-20T23:11:41.659 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T23:11:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:42 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi170 to 3760M 2024-09-20T23:11:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:42 smithi191 ceph-mon[24760]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:42 smithi191 ceph-mon[24760]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T23:11:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:42 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:42 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:42.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:11:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi170 to 3760M 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[23733]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[23733]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi170 to 3760M 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[28691]: from='osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[28691]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T23:11:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:42 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:43.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:11:43.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:11:43.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086] boot 2024-09-20T23:11:43.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: osdmap e26: 4 total, 4 up, 4 in 2024-09-20T23:11:43.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:43.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi170 2024-09-20T23:11:43.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:43 smithi191 ceph-mon[24760]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:11:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086] boot 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: osdmap e26: 4 total, 4 up, 4 in 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi170 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[23733]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:11:43.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: osd.3 [v2:172.21.15.170:6826/491345086,v1:172.21.15.170:6827/491345086] boot 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: osdmap e26: 4 total, 4 up, 4 in 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi170 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:43 smithi170 ceph-mon[28691]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:44.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:44 smithi191 ceph-mon[24760]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T23:11:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:11:44.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-09-20T23:11:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:44 smithi170 ceph-mon[23733]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T23:11:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:44 smithi170 ceph-mon[28691]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T23:11:45.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:45 smithi191 ceph-mon[24760]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:45 smithi170 ceph-mon[23733]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:45 smithi170 ceph-mon[28691]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:46.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:46 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:46.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:46 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:46.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:46 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:46.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:46.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:46.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:46.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:11:46.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:11:46.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:46.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:11:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:11:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[23733]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[23733]: from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[28691]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[28691]: from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:47 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:47.677 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:47 smithi191 ceph-mon[24760]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:47.678 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:47 smithi191 ceph-mon[24760]: from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:47.678 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:47.678 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:47 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/3904651347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]': finished 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: osdmap e28: 5 total, 4 up, 5 in 2024-09-20T23:11:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:49 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:11:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/3904651347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]': finished 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: osdmap e28: 5 total, 4 up, 5 in 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/3904651347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]: dispatch 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa93070-fbb3-4a03-9851-b695067b0966"}]': finished 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: osdmap e28: 5 total, 4 up, 5 in 2024-09-20T23:11:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:49 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:11:50.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:50 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/1797204641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:50 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/1797204641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:50 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/1797204641' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:11:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:51 smithi191 ceph-mon[24760]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:51 smithi170 ceph-mon[23733]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:51 smithi170 ceph-mon[28691]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:53.552 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:53 smithi191 ceph-mon[24760]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:53 smithi170 ceph-mon[23733]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:53 smithi170 ceph-mon[28691]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:55.643 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:55 smithi191 ceph-mon[24760]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:55.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:55 smithi170 ceph-mon[23733]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:55.664 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:55 smithi170 ceph-mon[28691]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:56.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:11:56.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:56 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:11:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:56 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:56.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:11:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:56 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:57.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:57 smithi170 ceph-mon[23733]: Deploying daemon osd.4 on smithi191 2024-09-20T23:11:57.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:57 smithi170 ceph-mon[23733]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:57 smithi170 ceph-mon[28691]: Deploying daemon osd.4 on smithi191 2024-09-20T23:11:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:57 smithi170 ceph-mon[28691]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:57.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:57 smithi191 ceph-mon[24760]: Deploying daemon osd.4 on smithi191 2024-09-20T23:11:57.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:57 smithi191 ceph-mon[24760]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:59.199 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:11:59 smithi191 ceph-mon[24760]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:59.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:11:59 smithi170 ceph-mon[23733]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:59.302 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:11:59 smithi170 ceph-mon[28691]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:11:59.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:11:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:11:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:00.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:00.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:01.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:01.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:01.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:01.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:01 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:01 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:03 smithi191 ceph-mon[24760]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:03.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:03 smithi170 ceph-mon[23733]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:03.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:03 smithi170 ceph-mon[28691]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:03.979 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 4 on host 'smithi191' 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:04.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:04 smithi191 ceph-mon[24760]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:04.640 DEBUG:teuthology.orchestra.run.smithi191:osd.4> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service 2024-09-20T23:12:04.643 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2024-09-20T23:12:04.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T23:12:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[23733]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:04.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:04.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:04.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:04 smithi170 ceph-mon[28691]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi191 to 16064M 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: osdmap e29: 5 total, 4 up, 5 in 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:05 smithi191 ceph-mon[24760]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi191 to 16064M 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:12:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: osdmap e29: 5 total, 4 up, 5 in 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[28691]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi191 to 16064M 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: osdmap e29: 5 total, 4 up, 5 in 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:05 smithi170 ceph-mon[23733]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:06.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:12:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[29387]: 2024-09-20T23:12:06.002+0000 7f104efc6700 -1 osd.4 0 waiting for initial osdmap 2024-09-20T23:12:06.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:12:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[29387]: 2024-09-20T23:12:06.008+0000 7f104995d700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: osdmap e30: 5 total, 4 up, 5 in 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:07.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:07.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:07.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:07 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:07.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:07.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: osdmap e30: 5 total, 4 up, 5 in 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[28691]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[28691]: osdmap e30: 5 total, 4 up, 5 in 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:06 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:07.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:07 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:07.417 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:12:07.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-09-20T23:12:08.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:12:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:12:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi191 2024-09-20T23:12:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836] boot 2024-09-20T23:12:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: osdmap e31: 5 total, 5 up, 5 in 2024-09-20T23:12:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:08 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:08.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:12:08.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:12:08.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi191 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836] boot 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: osdmap e31: 5 total, 5 up, 5 in 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi191 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: osd.4 [v2:172.21.15.191:6800/2343531836,v1:172.21.15.191:6801/2343531836] boot 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: osdmap e31: 5 total, 5 up, 5 in 2024-09-20T23:12:08.421 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:12:08.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:09.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: osdmap e32: 5 total, 5 up, 5 in 2024-09-20T23:12:09.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:09.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:09.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:09.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:09.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: osdmap e32: 5 total, 5 up, 5 in 2024-09-20T23:12:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: osdmap e32: 5 total, 5 up, 5 in 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:09.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:10.389 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:10 smithi191 ceph-mon[24760]: osdmap e33: 5 total, 5 up, 5 in 2024-09-20T23:12:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:10 smithi170 ceph-mon[23733]: osdmap e33: 5 total, 5 up, 5 in 2024-09-20T23:12:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:10 smithi170 ceph-mon[28691]: osdmap e33: 5 total, 5 up, 5 in 2024-09-20T23:12:11.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: osdmap e34: 5 total, 5 up, 5 in 2024-09-20T23:12:11.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:11.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:11.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:11.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:11.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:11 smithi191 ceph-mon[24760]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: osdmap e34: 5 total, 5 up, 5 in 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[23733]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: osdmap e34: 5 total, 5 up, 5 in 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:11 smithi170 ceph-mon[28691]: pgmap v119: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-20T23:12:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:12 smithi191 ceph-mon[24760]: osdmap e35: 5 total, 5 up, 5 in 2024-09-20T23:12:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:12 smithi170 ceph-mon[23733]: osdmap e35: 5 total, 5 up, 5 in 2024-09-20T23:12:12.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:12 smithi170 ceph-mon[28691]: osdmap e35: 5 total, 5 up, 5 in 2024-09-20T23:12:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-20T23:12:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/202112034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]': finished 2024-09-20T23:12:13.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: osdmap e36: 6 total, 5 up, 6 in 2024-09-20T23:12:13.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:13 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:13.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-20T23:12:13.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/202112034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]': finished 2024-09-20T23:12:13.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: osdmap e36: 6 total, 5 up, 6 in 2024-09-20T23:12:13.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:13.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-20T23:12:13.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/202112034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]: dispatch 2024-09-20T23:12:13.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f54a25d-9950-4e6e-856a-2c43546542f8"}]': finished 2024-09-20T23:12:13.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: osdmap e36: 6 total, 5 up, 6 in 2024-09-20T23:12:13.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:13 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:14 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/1802142048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:14 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/1802142048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:14 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/1802142048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:15.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:15 smithi191 ceph-mon[24760]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:15 smithi170 ceph-mon[23733]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:15 smithi170 ceph-mon[28691]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:17.697 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:17 smithi191 ceph-mon[24760]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:17 smithi170 ceph-mon[23733]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:17.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:17 smithi170 ceph-mon[28691]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:19.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:19 smithi170 ceph-mon[23733]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:19.402 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:19 smithi170 ceph-mon[28691]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:19.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:19 smithi191 ceph-mon[24760]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:19.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:19 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:12:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:12:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:12:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:21 smithi191 ceph-mon[24760]: Deploying daemon osd.5 on smithi191 2024-09-20T23:12:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:21 smithi191 ceph-mon[24760]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:21 smithi170 ceph-mon[28691]: Deploying daemon osd.5 on smithi191 2024-09-20T23:12:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:21 smithi170 ceph-mon[28691]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:21 smithi170 ceph-mon[23733]: Deploying daemon osd.5 on smithi191 2024-09-20T23:12:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:21 smithi170 ceph-mon[23733]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:23 smithi191 ceph-mon[24760]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:23 smithi170 ceph-mon[28691]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:23.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:23 smithi170 ceph-mon[23733]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:25.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:25 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:25 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:27.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:27 smithi191 ceph-mon[24760]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:27.669 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-09-20T23:12:27.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:27 smithi170 ceph-mon[28691]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:27.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:27 smithi170 ceph-mon[23733]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:28.410 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service 2024-09-20T23:12:28.413 INFO:tasks.cephadm:Deploying osd.6 on smithi191 with /dev/vg_nvme/lv_2... 2024-09-20T23:12:28.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi191 to 8032M 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:28 smithi191 ceph-mon[24760]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:28.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:28.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:28.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:28.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi191 to 8032M 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[28691]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi191 to 8032M 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:12:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:28 smithi170 ceph-mon[23733]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi191 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:29 smithi191 ceph-mon[24760]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi191 2024-09-20T23:12:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[23733]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi191 2024-09-20T23:12:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:29 smithi170 ceph-mon[28691]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:30.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:12:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[32276]: 2024-09-20T23:12:30.033+0000 7fda58b2d700 -1 osd.5 0 waiting for initial osdmap 2024-09-20T23:12:30.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:12:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[32276]: 2024-09-20T23:12:30.038+0000 7fda51cc1700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:12:31.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: osdmap e38: 6 total, 5 up, 6 in 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: osdmap e38: 6 total, 5 up, 6 in 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: osdmap e38: 6 total, 5 up, 6 in 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.292 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:31.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:31.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:31.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:31.869 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:12:31.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-09-20T23:12:32.193 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:32 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:12:32.194 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:32 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:12:32.194 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:32 smithi191 ceph-mon[24760]: osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745] boot 2024-09-20T23:12:32.194 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:32 smithi191 ceph-mon[24760]: osdmap e39: 6 total, 6 up, 6 in 2024-09-20T23:12:32.194 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:32 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:12:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:12:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[28691]: osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745] boot 2024-09-20T23:12:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[28691]: osdmap e39: 6 total, 6 up, 6 in 2024-09-20T23:12:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:12:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:12:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[23733]: osd.5 [v2:172.21.15.191:6808/1293651745,v1:172.21.15.191:6809/1293651745] boot 2024-09-20T23:12:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[23733]: osdmap e39: 6 total, 6 up, 6 in 2024-09-20T23:12:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:32 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:12:33.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:33 smithi191 ceph-mon[24760]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T23:12:33.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:33 smithi191 ceph-mon[24760]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:33 smithi170 ceph-mon[23733]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T23:12:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:33 smithi170 ceph-mon[23733]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:33 smithi170 ceph-mon[28691]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T23:12:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:33 smithi170 ceph-mon[28691]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:34 smithi191 ceph-mon[24760]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:12:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:34 smithi191 ceph-mon[24760]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T23:12:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:34 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:34 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:34 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[23733]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[23733]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[28691]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:12:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[28691]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T23:12:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:12:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:12:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:34 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:35.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:35 smithi191 ceph-mon[24760]: from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:35 smithi191 ceph-mon[24760]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T23:12:35.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:35 smithi191 ceph-mon[24760]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[28691]: from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[28691]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T23:12:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[28691]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[23733]: from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[23733]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T23:12:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:35 smithi170 ceph-mon[23733]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:36 smithi170 ceph-mon[23733]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T23:12:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:36 smithi170 ceph-mon[28691]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T23:12:36.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:36 smithi191 ceph-mon[24760]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T23:12:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:37 smithi170 ceph-mon[23733]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-20T23:12:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:37 smithi170 ceph-mon[28691]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-20T23:12:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:37 smithi191 ceph-mon[24760]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-20T23:12:38.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:12:38.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: Cluster is now healthy 2024-09-20T23:12:38.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/1361809895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]': finished 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: osdmap e44: 7 total, 6 up, 7 in 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: Cluster is now healthy 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/1361809895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]': finished 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: osdmap e44: 7 total, 6 up, 7 in 2024-09-20T23:12:38.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:38 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: Cluster is now healthy 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/1361809895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]: dispatch 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f449900-d227-4293-95fd-4b2b0a143ae2"}]': finished 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: osdmap e44: 7 total, 6 up, 7 in 2024-09-20T23:12:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:38 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:39 smithi191 ceph-mon[24760]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:39 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/689392416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:39 smithi170 ceph-mon[23733]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:39 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/689392416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:39 smithi170 ceph-mon[28691]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-20T23:12:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:39 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/689392416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:12:39.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:12:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:40.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[23733]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:12:40.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:40 smithi170 ceph-mon[28691]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:12:40.944 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:40 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.944 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:40 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:40.944 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:40 smithi191 ceph-mon[24760]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:12:43.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:43 smithi191 ceph-mon[24760]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:12:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:43 smithi170 ceph-mon[23733]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:12:43.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:43 smithi170 ceph-mon[28691]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:12:44.614 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:44 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:12:44.614 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:44 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:44 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:12:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:44 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:44.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:44 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:12:44.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:44 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:45.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:45 smithi191 ceph-mon[24760]: Deploying daemon osd.6 on smithi191 2024-09-20T23:12:45.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:45 smithi191 ceph-mon[24760]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:12:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:45 smithi170 ceph-mon[23733]: Deploying daemon osd.6 on smithi191 2024-09-20T23:12:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:45 smithi170 ceph-mon[23733]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:12:45.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:45 smithi170 ceph-mon[28691]: Deploying daemon osd.6 on smithi191 2024-09-20T23:12:45.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:45 smithi170 ceph-mon[28691]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:12:47.596 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:47 smithi191 ceph-mon[24760]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:47.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:47 smithi170 ceph-mon[23733]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:47.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:47 smithi170 ceph-mon[28691]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:49.140 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:49 smithi191 ceph-mon[24760]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:49 smithi170 ceph-mon[28691]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:49 smithi170 ceph-mon[23733]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:50.460 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:50 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:50.460 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:50 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.460 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:50 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.460 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:50 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.460 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:50 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:50 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:51.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:51.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:51 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:51.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:51.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:51.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:51.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:51.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:51 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:52.127 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 6 on host 'smithi191' 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:53 smithi191 ceph-mon[24760]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[28691]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:12:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:53 smithi170 ceph-mon[23733]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:53.672 DEBUG:teuthology.orchestra.run.smithi191:osd.6> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service 2024-09-20T23:12:53.674 INFO:tasks.cephadm:Deploying osd.7 on smithi191 with /dev/vg_nvme/lv_1... 2024-09-20T23:12:53.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-20T23:12:54.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-mon[24760]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:12:54.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-mon[24760]: osdmap e45: 7 total, 6 up, 7 in 2024-09-20T23:12:54.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:54.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-mon[24760]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:54.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-mon[24760]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:54.407 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[35199]: 2024-09-20T23:12:54.188+0000 7efd6055e700 -1 osd.6 0 waiting for initial osdmap 2024-09-20T23:12:54.407 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:12:54 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[35199]: 2024-09-20T23:12:54.195+0000 7efd58ef1700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[28691]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[28691]: osdmap e45: 7 total, 6 up, 7 in 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[28691]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[28691]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[23733]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:12:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[23733]: osdmap e45: 7 total, 6 up, 7 in 2024-09-20T23:12:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[23733]: from='osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:54 smithi170 ceph-mon[23733]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: osdmap e46: 7 total, 6 up, 7 in 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649] boot 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: osdmap e47: 7 total, 7 up, 7 in 2024-09-20T23:12:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:55 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: osdmap e46: 7 total, 6 up, 7 in 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649] boot 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: osdmap e47: 7 total, 7 up, 7 in 2024-09-20T23:12:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: osdmap e46: 7 total, 6 up, 7 in 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: osd.6 [v2:172.21.15.191:6816/161917649,v1:172.21.15.191:6817/161917649] boot 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: osdmap e47: 7 total, 7 up, 7 in 2024-09-20T23:12:55.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:55 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:12:56.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:56 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:12:56.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:56 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:12:56.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:56 smithi191 ceph-mon[24760]: osdmap e48: 7 total, 7 up, 7 in 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[23733]: osdmap e48: 7 total, 7 up, 7 in 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:12:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:56 smithi170 ceph-mon[28691]: osdmap e48: 7 total, 7 up, 7 in 2024-09-20T23:12:57.193 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:12:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:57 smithi191 ceph-mon[24760]: osdmap e49: 7 total, 7 up, 7 in 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[23733]: osdmap e49: 7 total, 7 up, 7 in 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:12:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:57 smithi170 ceph-mon[28691]: osdmap e49: 7 total, 7 up, 7 in 2024-09-20T23:12:57.752 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-20T23:12:57.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2024-09-20T23:12:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:58 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi191 2024-09-20T23:12:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:58 smithi170 ceph-mon[23733]: osdmap e50: 7 total, 7 up, 7 in 2024-09-20T23:12:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:58 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi191 2024-09-20T23:12:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:58 smithi170 ceph-mon[28691]: osdmap e50: 7 total, 7 up, 7 in 2024-09-20T23:12:58.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:58 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi191 2024-09-20T23:12:58.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:58 smithi191 ceph-mon[24760]: osdmap e50: 7 total, 7 up, 7 in 2024-09-20T23:12:59.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:59 smithi170 ceph-mon[28691]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:59.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:12:59 smithi170 ceph-mon[28691]: osdmap e51: 7 total, 7 up, 7 in 2024-09-20T23:12:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:59 smithi170 ceph-mon[23733]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:12:59 smithi170 ceph-mon[23733]: osdmap e51: 7 total, 7 up, 7 in 2024-09-20T23:12:59.449 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:59 smithi191 ceph-mon[24760]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:12:59.449 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:12:59 smithi191 ceph-mon[24760]: osdmap e51: 7 total, 7 up, 7 in 2024-09-20T23:12:59.938 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:12:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:12:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:00.681 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:00 smithi191 ceph-mon[24760]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:00.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[23733]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:00.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:00 smithi170 ceph-mon[28691]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-20T23:13:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:02 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/3040150653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:02 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:02 smithi191 ceph-mon[24760]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]': finished 2024-09-20T23:13:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:02 smithi191 ceph-mon[24760]: osdmap e52: 8 total, 7 up, 8 in 2024-09-20T23:13:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:02 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:02.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/3040150653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[23733]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]': finished 2024-09-20T23:13:02.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[23733]: osdmap e52: 8 total, 7 up, 8 in 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/3040150653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]: dispatch 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[28691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e10f3972-7269-4f69-be3d-8517b3a37a6d"}]': finished 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[28691]: osdmap e52: 8 total, 7 up, 8 in 2024-09-20T23:13:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:02 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:03.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:03 smithi191 ceph-mon[24760]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-20T23:13:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:03 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/994437381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:13:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:03 smithi170 ceph-mon[23733]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-20T23:13:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:03 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/994437381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:13:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:03 smithi170 ceph-mon[28691]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-20T23:13:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:03 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/994437381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T23:13:05.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:05 smithi191 ceph-mon[24760]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:13:05.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:05.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:05 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[23733]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:13:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[28691]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-20T23:13:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:05.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:05 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:07.577 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:07 smithi191 ceph-mon[24760]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:13:07.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:07 smithi170 ceph-mon[23733]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:13:07.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:07 smithi170 ceph-mon[28691]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-20T23:13:09.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[23733]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:13:09.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:13:09.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:09.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[23733]: Deploying daemon osd.7 on smithi191 2024-09-20T23:13:09.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[28691]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:13:09.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:13:09.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:09.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:09 smithi170 ceph-mon[28691]: Deploying daemon osd.7 on smithi191 2024-09-20T23:13:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:09 smithi191 ceph-mon[24760]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-20T23:13:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:13:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:09 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:09 smithi191 ceph-mon[24760]: Deploying daemon osd.7 on smithi191 2024-09-20T23:13:11.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:11 smithi191 ceph-mon[24760]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:11.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:11 smithi170 ceph-mon[23733]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:11 smithi170 ceph-mon[28691]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:13.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:13 smithi191 ceph-mon[24760]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:13.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:13 smithi170 ceph-mon[28691]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:13 smithi170 ceph-mon[23733]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:15 smithi191 ceph-mon[24760]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[28691]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:15.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:15 smithi170 ceph-mon[23733]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:17.301 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:17.598 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:17.598 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.598 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.598 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:17.599 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:17.599 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:17.599 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:17 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:17.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:17.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:17 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: Detected new or changed devices on smithi191 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:18.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:18.536 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:18.536 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:18 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.566 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 7 on host 'smithi191' 2024-09-20T23:13:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: Detected new or changed devices on smithi191 2024-09-20T23:13:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: Detected new or changed devices on smithi191 2024-09-20T23:13:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:18 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.214 DEBUG:teuthology.orchestra.run.smithi191:osd.7> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.7.service 2024-09-20T23:13:19.217 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-20T23:13:19.218 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: osdmap e53: 8 total, 7 up, 8 in 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.478 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[38210]: 2024-09-20T23:13:19.314+0000 7efcc03b9700 -1 osd.7 0 waiting for initial osdmap 2024-09-20T23:13:19.478 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:13:19 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[38210]: 2024-09-20T23:13:19.322+0000 7efcbb551700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:13:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: osdmap e53: 8 total, 7 up, 8 in 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: osdmap e53: 8 total, 7 up, 8 in 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:19.769 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:19 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:13:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: Adjusting osd_memory_target on smithi191 to 4016M 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: osdmap e54: 8 total, 7 up, 8 in 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:20 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: Adjusting osd_memory_target on smithi191 to 4016M 2024-09-20T23:13:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: osdmap e54: 8 total, 7 up, 8 in 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: Adjusting osd_memory_target on smithi191 to 4016M 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: osdmap e54: 8 total, 7 up, 8 in 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:20 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:21.479 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: purged_snaps scrub starts 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: purged_snaps scrub ok 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648] boot 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: osdmap e55: 8 total, 8 up, 8 in 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:21 smithi191 ceph-mon[24760]: osdmap e56: 8 total, 8 up, 8 in 2024-09-20T23:13:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: purged_snaps scrub starts 2024-09-20T23:13:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: purged_snaps scrub ok 2024-09-20T23:13:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648] boot 2024-09-20T23:13:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: osdmap e55: 8 total, 8 up, 8 in 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[28691]: osdmap e56: 8 total, 8 up, 8 in 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: purged_snaps scrub starts 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: purged_snaps scrub ok 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-20T23:13:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: osd.7 [v2:172.21.15.191:6824/3124763648,v1:172.21.15.191:6825/3124763648] boot 2024-09-20T23:13:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: osdmap e55: 8 total, 8 up, 8 in 2024-09-20T23:13:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:21 smithi170 ceph-mon[23733]: osdmap e56: 8 total, 8 up, 8 in 2024-09-20T23:13:22.203 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1726874000,"num_in_osds":8,"osd_in_since":1726873981,"num_remapped_pgs":1} 2024-09-20T23:13:22.203 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T23:13:22.323 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/81094802' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T23:13:22.323 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:22 smithi170 ceph-mon[28691]: osdmap e57: 8 total, 8 up, 8 in 2024-09-20T23:13:22.413 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:13:22.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/81094802' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T23:13:22.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:22 smithi170 ceph-mon[23733]: osdmap e57: 8 total, 8 up, 8 in 2024-09-20T23:13:22.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/81094802' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T23:13:22.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:22 smithi191 ceph-mon[24760]: osdmap e57: 8 total, 8 up, 8 in 2024-09-20T23:13:23.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:23 smithi170 ceph-mon[23733]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:23.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:23 smithi170 ceph-mon[23733]: osdmap e58: 8 total, 8 up, 8 in 2024-09-20T23:13:23.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:23 smithi170 ceph-mon[28691]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:23.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:23 smithi170 ceph-mon[28691]: osdmap e58: 8 total, 8 up, 8 in 2024-09-20T23:13:23.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:23 smithi191 ceph-mon[24760]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:23.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:23 smithi191 ceph-mon[24760]: osdmap e58: 8 total, 8 up, 8 in 2024-09-20T23:13:24.114 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:13:24.114 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":59,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","created":"2024-09-20T23:08:17.637812+0000","modified":"2024-09-20T23:13:24.036662+0000","last_up_change":"2024-09-20T23:13:20.308113+0000","last_in_change":"2024-09-20T23:13:01.983253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T23:11:18.809979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f3ce0997-6af3-4134-8516-f7e91b087e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6803","nonce":3598562870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6805","nonce":3598562870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6809","nonce":3598562870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6807","nonce":3598562870}]},"public_addr":"172.21.15.170:6803/3598562870","cluster_addr":"172.21.15.170:6805/3598562870","heartbeat_back_addr":"172.21.15.170:6809/3598562870","heartbeat_front_addr":"172.21.15.170:6807/3598562870","state":["exists","up"]},{"osd":1,"uuid":"2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6811","nonce":81196034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6813","nonce":81196034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6817","nonce":81196034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6815","nonce":81196034}]},"public_addr":"172.21.15.170:6811/81196034","cluster_addr":"172.21.15.170:6813/81196034","heartbeat_back_addr":"172.21.15.170:6817/81196034","heartbeat_front_addr":"172.21.15.170:6815/81196034","state":["exists","up"]},{"osd":2,"uuid":"b49c0282-93c6-46d2-ba8a-2767884b07c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6819","nonce":2504239567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6821","nonce":2504239567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6825","nonce":2504239567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6823","nonce":2504239567}]},"public_addr":"172.21.15.170:6819/2504239567","cluster_addr":"172.21.15.170:6821/2504239567","heartbeat_back_addr":"172.21.15.170:6825/2504239567","heartbeat_front_addr":"172.21.15.170:6823/2504239567","state":["exists","up"]},{"osd":3,"uuid":"f02cfafe-5ac9-48ce-90c2-65b02b4efc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6827","nonce":491345086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6829","nonce":491345086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6833","nonce":491345086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6831","nonce":491345086}]},"public_addr":"172.21.15.170:6827/491345086","cluster_addr":"172.21.15.170:6829/491345086","heartbeat_back_addr":"172.21.15.170:6833/491345086","heartbeat_front_addr":"172.21.15.170:6831/491345086","state":["exists","up"]},{"osd":4,"uuid":"cfa93070-fbb3-4a03-9851-b695067b0966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6801","nonce":2343531836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6803","nonce":2343531836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6807","nonce":2343531836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6805","nonce":2343531836}]},"public_addr":"172.21.15.191:6801/2343531836","cluster_addr":"172.21.15.191:6803/2343531836","heartbeat_back_addr":"172.21.15.191:6807/2343531836","heartbeat_front_addr":"172.21.15.191:6805/2343531836","state":["exists","up"]},{"osd":5,"uuid":"2f54a25d-9950-4e6e-856a-2c43546542f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6809","nonce":1293651745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6811","nonce":1293651745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6815","nonce":1293651745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6813","nonce":1293651745}]},"public_addr":"172.21.15.191:6809/1293651745","cluster_addr":"172.21.15.191:6811/1293651745","heartbeat_back_addr":"172.21.15.191:6815/1293651745","heartbeat_front_addr":"172.21.15.191:6813/1293651745","state":["exists","up"]},{"osd":6,"uuid":"5f449900-d227-4293-95fd-4b2b0a143ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6817","nonce":161917649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6819","nonce":161917649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6823","nonce":161917649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6821","nonce":161917649}]},"public_addr":"172.21.15.191:6817/161917649","cluster_addr":"172.21.15.191:6819/161917649","heartbeat_back_addr":"172.21.15.191:6823/161917649","heartbeat_front_addr":"172.21.15.191:6821/161917649","state":["exists","up"]},{"osd":7,"uuid":"e10f3972-7269-4f69-be3d-8517b3a37a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6825","nonce":3124763648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6827","nonce":3124763648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6831","nonce":3124763648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6829","nonce":3124763648}]},"public_addr":"172.21.15.191:6825/3124763648","cluster_addr":"172.21.15.191:6827/3124763648","heartbeat_back_addr":"172.21.15.191:6831/3124763648","heartbeat_front_addr":"172.21.15.191:6829/3124763648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:29.032170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:51.350141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:15.530791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:40.815861+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:05.191915+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:29.157735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:53.210496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:13:18.384602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/157478380":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/986208701":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6800/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/3220406731":"2024-09-21T23:08:41.281561+0000","172.21.15.170:6800/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/292263619":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/4101521945":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/3118221257":"2024-09-21T23:08:41.281561+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T23:13:24.795 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T23:11:18.809979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-20T23:13:24.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-20T23:13:25.000 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:13:25.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[23733]: osdmap e59: 8 total, 8 up, 8 in 2024-09-20T23:13:25.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1179177939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:13:25.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[23733]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:25.355 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[28691]: osdmap e59: 8 total, 8 up, 8 in 2024-09-20T23:13:25.355 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1179177939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:13:25.355 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:25 smithi170 ceph-mon[28691]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:25.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:25 smithi191 ceph-mon[24760]: osdmap e59: 8 total, 8 up, 8 in 2024-09-20T23:13:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:25 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1179177939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:13:25.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:25 smithi191 ceph-mon[24760]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:26.809 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-09-20T23:13:27.357 INFO:tasks.cephadm:Adding prometheus.a on smithi191 2024-09-20T23:13:27.358 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply prometheus '1;smithi191=a' 2024-09-20T23:13:27.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:27 smithi170 ceph-mon[28691]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-20T23:13:27.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:27 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2989422792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T23:13:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:27 smithi170 ceph-mon[23733]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-20T23:13:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:27 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2989422792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T23:13:27.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:27 smithi191 ceph-mon[24760]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-20T23:13:27.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:27 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2989422792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T23:13:29.315 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled prometheus update... 2024-09-20T23:13:29.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:29 smithi191 ceph-mon[24760]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-20T23:13:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:29 smithi170 ceph-mon[23733]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-20T23:13:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:29 smithi170 ceph-mon[28691]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-20T23:13:30.112 DEBUG:teuthology.orchestra.run.smithi191:prometheus.a> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service 2024-09-20T23:13:30.114 INFO:tasks.cephadm:Adding node-exporter.a on smithi170 2024-09-20T23:13:30.114 INFO:tasks.cephadm:Adding node-exporter.b on smithi191 2024-09-20T23:13:30.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply node-exporter '2;smithi170=a;smithi191=b' 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: Saving service prometheus spec with placement smithi191=a;count:1 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: Saving service prometheus spec with placement smithi191=a;count:1 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: Saving service prometheus spec with placement smithi191=a;count:1 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:30.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setuser ceph since I am not root 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setgroup ceph since I am not root 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-mgr[23966]: -- 172.21.15.170:0/2787975682 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55586db0e340 con 0x55586dae6c00 2024-09-20T23:13:30.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:30.531+0000 7fb9a9328000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:13:30.614 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:30.608+0000 7fb9a9328000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:13:30.716 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ignoring --setuser ceph since I am not root 2024-09-20T23:13:30.716 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ignoring --setgroup ceph since I am not root 2024-09-20T23:13:30.716 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-mgr[26242]: -- 172.21.15.191:0/3402731169 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557053108340 con 0x5570530e1000 2024-09-20T23:13:30.716 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:30.520+0000 7fef1ae16000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:13:30.716 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:30.597+0000 7fef1ae16000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:13:30.872 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:30.782+0000 7fb9a9328000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:13:30.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:30.783+0000 7fef1ae16000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:13:30.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:30.871+0000 7fef1ae16000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:13:31.212 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:30.870+0000 7fb9a9328000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:13:31.213 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:31.001+0000 7fb9a9328000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:13:31.213 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:31.210+0000 7fb9a9328000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:13:31.365 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:31.002+0000 7fef1ae16000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:13:31.365 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:31.216+0000 7fef1ae16000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-mon[23733]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-mon[23733]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-20T23:13:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-mon[28691]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-mon[28691]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-20T23:13:31.644 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-mon[24760]: from='mgr.14150 172.21.15.170:0/508330368' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:31.644 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-mon[24760]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-20T23:13:31.645 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:31.552+0000 7fef1ae16000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:13:31.914 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:31.642+0000 7fef1ae16000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:13:31.914 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:31.815+0000 7fef1ae16000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:13:31.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:31.540+0000 7fb9a9328000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:13:31.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:31.626+0000 7fb9a9328000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:13:31.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:31.788+0000 7fb9a9328000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:13:33.123 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:32.889+0000 7fef1ae16000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:13:33.123 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:32.995+0000 7fef1ae16000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:13:33.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:32.838+0000 7fb9a9328000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:13:33.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:32.929+0000 7fb9a9328000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:13:34.130 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:33.960+0000 7fef1ae16000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:13:34.141 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:33.828+0000 7fb9a9328000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:13:34.405 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.287+0000 7fef1ae16000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:13:34.463 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.139+0000 7fb9a9328000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:13:34.463 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.272+0000 7fb9a9328000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:13:34.463 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.361+0000 7fb9a9328000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:13:34.708 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.424+0000 7fef1ae16000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:13:34.708 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.513+0000 7fef1ae16000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:13:34.708 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.615+0000 7fef1ae16000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:13:34.708 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.706+0000 7fef1ae16000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:13:34.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.461+0000 7fb9a9328000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:13:34.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.550+0000 7fb9a9328000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:13:34.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.699+0000 7fb9a9328000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:13:34.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.859+0000 7fef1ae16000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:13:34.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:34.956+0000 7fef1ae16000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:13:35.181 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.794+0000 7fb9a9328000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:13:35.181 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:34.891+0000 7fb9a9328000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:13:35.357 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:35.056+0000 7fef1ae16000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:13:35.357 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:35.355+0000 7fef1ae16000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:13:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:35.178+0000 7fb9a9328000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:13:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:35.268+0000 7fb9a9328000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:13:35.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:35.357+0000 7fb9a9328000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:13:35.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:35.444+0000 7fef1ae16000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:13:35.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:35.533+0000 7fef1ae16000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:13:36.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[23733]: Active manager daemon y restarted 2024-09-20T23:13:36.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[23733]: Activating manager daemon y 2024-09-20T23:13:36.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[23733]: osdmap e60: 8 total, 8 up, 8 in 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[28691]: Active manager daemon y restarted 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[28691]: Activating manager daemon y 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-mon[28691]: osdmap e60: 8 total, 8 up, 8 in 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:36.433+0000 7fb9a9328000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:36] ENGINE Bus STARTING 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: CherryPy Checker: 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: The Application mounted at '' has an empty config. 2024-09-20T23:13:36.732 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:13:36.733 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:36] ENGINE Serving on http://:::9283 2024-09-20T23:13:36.733 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:36] ENGINE Bus STARTED 2024-09-20T23:13:36.811 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-mon[24760]: Active manager daemon y restarted 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-mon[24760]: Activating manager daemon y 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-mon[24760]: osdmap e60: 8 total, 8 up, 8 in 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:36.612+0000 7fef1ae16000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: [20/Sep/2024:23:13:36] ENGINE Bus STARTING 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: CherryPy Checker: 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: The Application mounted at '' has an empty config. 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: [20/Sep/2024:23:13:36] ENGINE Serving on http://:::9283 2024-09-20T23:13:36.812 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:13:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: [20/Sep/2024:23:13:36] ENGINE Bus STARTED 2024-09-20T23:13:37.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:37] ENGINE Bus STARTING 2024-09-20T23:13:37.527 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled node-exporter update... 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:37] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:13:37] ENGINE Bus STARTED 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: mgrmap e17: y(active, starting, since 0.0561599s), standbys: x 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:13:37.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Manager daemon y is now available 2024-09-20T23:13:37.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: mgrmap e17: y(active, starting, since 0.0561599s), standbys: x 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:13:37.653 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Manager daemon y is now available 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Standby manager daemon x restarted 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Standby manager daemon x started 2024-09-20T23:13:37.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: [20/Sep/2024:23:13:37] ENGINE Bus STARTING 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: [20/Sep/2024:23:13:37] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: [20/Sep/2024:23:13:37] ENGINE Bus STARTED 2024-09-20T23:13:37.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Standby manager daemon x restarted 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Standby manager daemon x started 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: [20/Sep/2024:23:13:37] ENGINE Bus STARTING 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: [20/Sep/2024:23:13:37] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: [20/Sep/2024:23:13:37] ENGINE Bus STARTED 2024-09-20T23:13:37.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: mgrmap e17: y(active, starting, since 0.0561599s), standbys: x 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:13:37.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Manager daemon y is now available 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.880 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]': finished 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Standby manager daemon x restarted 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Standby manager daemon x started 2024-09-20T23:13:37.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/3783211486' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: [20/Sep/2024:23:13:37] ENGINE Bus STARTING 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: [20/Sep/2024:23:13:37] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: [20/Sep/2024:23:13:37] ENGINE Bus STARTED 2024-09-20T23:13:37.882 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:38.232 DEBUG:teuthology.orchestra.run.smithi170:node-exporter.a> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service 2024-09-20T23:13:38.235 DEBUG:teuthology.orchestra.run.smithi191:node-exporter.b> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service 2024-09-20T23:13:38.238 INFO:tasks.cephadm:Adding alertmanager.a on smithi170 2024-09-20T23:13:38.238 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply alertmanager '1;smithi170=a' 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: mgrmap e18: y(active, since 1.07402s), standbys: x 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi170=a;smithi191=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: Saving service node-exporter spec with placement smithi170=a;smithi191=b;count:2 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[23733]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: mgrmap e18: y(active, since 1.07402s), standbys: x 2024-09-20T23:13:38.774 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi170=a;smithi191=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:38.775 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:38.775 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: Saving service node-exporter spec with placement smithi170=a;smithi191=b;count:2 2024-09-20T23:13:38.775 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:38.775 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:38 smithi170 ceph-mon[28691]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: mgrmap e18: y(active, since 1.07402s), standbys: x 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi170=a;smithi191=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: Saving service node-exporter spec with placement smithi170=a;smithi191=b;count:2 2024-09-20T23:13:38.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:38.820 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:38 smithi191 ceph-mon[24760]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:13:39.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:13:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:40.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:40 smithi191 ceph-mon[24760]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:40 smithi191 ceph-mon[24760]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-20T23:13:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[23733]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[23733]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[28691]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[28691]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-20T23:13:40.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:40.913 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled alertmanager update... 2024-09-20T23:13:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:41 smithi191 ceph-mon[24760]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:41 smithi191 ceph-mon[24760]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi170=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:41 smithi191 ceph-mon[24760]: Saving service alertmanager spec with placement smithi170=a;count:1 2024-09-20T23:13:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:41 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[23733]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[23733]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi170=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[23733]: Saving service alertmanager spec with placement smithi170=a;count:1 2024-09-20T23:13:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:42.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[28691]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:42.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[28691]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi170=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:42.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[28691]: Saving service alertmanager spec with placement smithi170=a;count:1 2024-09-20T23:13:42.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:41 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:42.316 DEBUG:teuthology.orchestra.run.smithi170:alertmanager.a> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service 2024-09-20T23:13:42.320 INFO:tasks.cephadm:Adding grafana.a on smithi191 2024-09-20T23:13:42.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph orch apply grafana '1;smithi191=a' 2024-09-20T23:13:44.384 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:44 smithi191 ceph-mon[24760]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:44 smithi170 ceph-mon[23733]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:44 smithi170 ceph-mon[28691]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:46.214 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled grafana update... 2024-09-20T23:13:46.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:46 smithi191 ceph-mon[24760]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:46 smithi170 ceph-mon[23733]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:46 smithi170 ceph-mon[28691]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:47.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:47 smithi191 ceph-mon[24760]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:47 smithi191 ceph-mon[24760]: Saving service grafana spec with placement smithi191=a;count:1 2024-09-20T23:13:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[23733]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[23733]: Saving service grafana spec with placement smithi191=a;count:1 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[28691]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi191=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[28691]: Saving service grafana spec with placement smithi191=a;count:1 2024-09-20T23:13:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:48.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:48 smithi191 ceph-mon[24760]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:48 smithi170 ceph-mon[23733]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:48.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:48 smithi170 ceph-mon[28691]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:49.583 DEBUG:teuthology.orchestra.run.smithi191:grafana.a> sudo journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@grafana.a.service 2024-09-20T23:13:49.585 INFO:tasks.cephadm:Setting up client nodes... 2024-09-20T23:13:49.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T23:13:49.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:49 smithi191 podman[40882]: 2024-09-20 23:13:49.859709423 +0000 UTC m=+0.137879724 container create e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:13:50.252 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-mon[24760]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 podman[40882]: 2024-09-20 23:13:50.095685729 +0000 UTC m=+0.373855994 container init e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 podman[40882]: 2024-09-20 23:13:50.098763773 +0000 UTC m=+0.376934030 container start e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:518 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi191 (none))" 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.122Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-20T23:13:50.253 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.125Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.125Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.126Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.127Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.127Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.639µs 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.127Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.127Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.127Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=19.529µs wal_replay_duration=139.864µs total_replay_duration=173.771µs 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.128Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.128Z caller=main.go:947 level=info msg="TSDB started" 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.128Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.144Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.707642ms db_storage=748ns remote_storage=1.748µs web_handler=213ns query_engine=925ns scrape=426.695µs scrape_sd=16.119µs notify=767ns notify_sd=1.261µs rules=15.012929ms 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:13:50.144Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 bash[40882]: e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 2024-09-20T23:13:50.254 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:13:50 smithi191 systemd[1]: Started Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:13:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:50 smithi170 ceph-mon[23733]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:50 smithi170 ceph-mon[28691]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.191:9095"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:51.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:13:51.795 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-09-20T23:13:51.795 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCvAe5mD2wcLxAAQaItoxLlgVS5mUHLAPgyZg== 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[23733]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/336362289' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[28691]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/336362289' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:52 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:52.531 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-20T23:13:52.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-20T23:13:52.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-20T23:13:52.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T23:13:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:52 smithi191 ceph-mon[24760]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:52 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:52 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/336362289' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:52 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:52 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:54.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:54 smithi191 ceph-mon[24760]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:54 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:54.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:54 smithi170 ceph-mon[23733]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:54 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:54.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:54 smithi170 ceph-mon[28691]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:54.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:54 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:55.498 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2024-09-20T23:13:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQCzAe5mznRRHRAAc3+34dPQNInEG/H/ZCfo7g== 2024-09-20T23:13:55.689 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:55.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:56.322 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-20T23:13:56.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-20T23:13:56.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-20T23:13:56.402 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T23:13:56.402 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-20T23:13:56.403 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-20T23:13:56.620 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:13:56.699 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:56 smithi191 ceph-mon[24760]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:56.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:56 smithi191 ceph-mon[24760]: from='client.? 172.21.15.191:0/1003016296' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:56 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:56 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[23733]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[23733]: from='client.? 172.21.15.191:0/1003016296' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[28691]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[28691]: from='client.? 172.21.15.191:0/1003016296' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T23:13:56.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T23:13:56.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:56.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:13:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:13:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[23733]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:57.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:57.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:57.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:57.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:57 smithi170 ceph-mon[28691]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:13:58.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:13:58.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:57 smithi191 ceph-mon[24760]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:13:58.618 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:13:58.993 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:13:58 smithi170 bash[44371]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-09-20T23:13:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:13:59 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3007657257' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T23:13:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:13:59 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3007657257' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T23:13:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:13:59 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3007657257' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T23:14:00.046 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:13:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:13:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:00 smithi191 ceph-mon[24760]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:00 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:00 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[23733]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[28691]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:00 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:00.628 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":19,"active_gid":24358,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2952835831},{"type":"v1","addr":"172.21.15.170:6801","nonce":2952835831}]},"active_addr":"172.21.15.170:6801/2952835831","active_change":"2024-09-20T23:13:36.436412+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":34322,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.170:8443/","prometheus":"http://172.21.15.170:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":60,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1796673929}]},{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1939028319}]},{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2874379495}]},{"addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2698591188}]}]}} 2024-09-20T23:14:00.633 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-20T23:14:00.633 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-20T23:14:00.634 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T23:14:00.993 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:00 smithi170 bash[44371]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-09-20T23:14:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:01.352 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 bash[44371]: Writing manifest to image destination 2024-09-20T23:14:01.654 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 podman[44371]: 2024-09-20 23:14:01.327205071 +0000 UTC m=+3.122370636 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-09-20T23:14:01.654 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 podman[44371]: 2024-09-20 23:14:01.450507968 +0000 UTC m=+3.245673506 container create 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:01.922 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 podman[44371]: 2024-09-20 23:14:01.652843726 +0000 UTC m=+3.448009278 container init 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:01.922 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 podman[44371]: 2024-09-20 23:14:01.655778892 +0000 UTC m=+3.450944428 container start 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:01.922 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.659Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-09-20T23:14:01.922 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.659Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-09-20T23:14:01.922 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.660Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.660Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.660Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=arp 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=bcache 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=bonding 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=btrfs 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=conntrack 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=cpu 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=diskstats 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=dmi 2024-09-20T23:14:01.923 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=edac 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=entropy 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=filefd 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=filesystem 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=hwmon 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=infiniband 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=ipvs 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=loadavg 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=mdadm 2024-09-20T23:14:01.924 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=meminfo 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=netclass 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=netdev 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=netstat 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=nfs 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=nfsd 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=nvme 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=os 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=pressure 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=rapl 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=schedstat 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=sockstat 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=softnet 2024-09-20T23:14:01.925 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=stat 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=tapestats 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=textfile 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=time 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=uname 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=vmstat 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=xfs 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:115 level=info collector=zfs 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[44675]: ts=2024-09-20T23:14:01.661Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 bash[44371]: 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de 2024-09-20T23:14:01.926 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:14:01 smithi170 systemd[1]: Started Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:14:02.114 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:02 smithi191 ceph-mon[24760]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:02.114 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:02.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:02 smithi170 ceph-mon[23733]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:02.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:02.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:02 smithi170 ceph-mon[28691]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:02.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:02.662 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:02 smithi191 systemd[1]: Starting Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:14:02.976 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:02 smithi191 bash[41813]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-09-20T23:14:03.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:03 smithi170 ceph-mon[23733]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:14:03.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:03 smithi170 ceph-mon[28691]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:14:03.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:03 smithi191 ceph-mon[24760]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:14:03.476 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:03 smithi191 bash[41813]: Getting image source signatures 2024-09-20T23:14:03.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:03 smithi191 bash[41813]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-09-20T23:14:03.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:03 smithi191 bash[41813]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-09-20T23:14:03.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:03 smithi191 bash[41813]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-09-20T23:14:04.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:04 smithi170 ceph-mon[23733]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:04.337 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:04 smithi170 ceph-mon[28691]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:04.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:04 smithi191 ceph-mon[24760]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:04.977 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:04 smithi191 bash[41813]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-09-20T23:14:04.977 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:04 smithi191 bash[41813]: Writing manifest to image destination 2024-09-20T23:14:05.252 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:04 smithi191 podman[41813]: 2024-09-20 23:14:04.989462047 +0000 UTC m=+2.420825705 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-09-20T23:14:05.252 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 podman[41813]: 2024-09-20 23:14:05.129627082 +0000 UTC m=+2.560990778 container create 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:14:05.437 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:14:05.437 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":60,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","created":"2024-09-20T23:08:17.637812+0000","modified":"2024-09-20T23:13:36.436024+0000","last_up_change":"2024-09-20T23:13:20.308113+0000","last_in_change":"2024-09-20T23:13:01.983253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T23:11:18.809979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f3ce0997-6af3-4134-8516-f7e91b087e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6803","nonce":3598562870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6805","nonce":3598562870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6809","nonce":3598562870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6807","nonce":3598562870}]},"public_addr":"172.21.15.170:6803/3598562870","cluster_addr":"172.21.15.170:6805/3598562870","heartbeat_back_addr":"172.21.15.170:6809/3598562870","heartbeat_front_addr":"172.21.15.170:6807/3598562870","state":["exists","up"]},{"osd":1,"uuid":"2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6811","nonce":81196034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6813","nonce":81196034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6817","nonce":81196034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6815","nonce":81196034}]},"public_addr":"172.21.15.170:6811/81196034","cluster_addr":"172.21.15.170:6813/81196034","heartbeat_back_addr":"172.21.15.170:6817/81196034","heartbeat_front_addr":"172.21.15.170:6815/81196034","state":["exists","up"]},{"osd":2,"uuid":"b49c0282-93c6-46d2-ba8a-2767884b07c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6819","nonce":2504239567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6821","nonce":2504239567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6825","nonce":2504239567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6823","nonce":2504239567}]},"public_addr":"172.21.15.170:6819/2504239567","cluster_addr":"172.21.15.170:6821/2504239567","heartbeat_back_addr":"172.21.15.170:6825/2504239567","heartbeat_front_addr":"172.21.15.170:6823/2504239567","state":["exists","up"]},{"osd":3,"uuid":"f02cfafe-5ac9-48ce-90c2-65b02b4efc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6827","nonce":491345086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6829","nonce":491345086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6833","nonce":491345086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6831","nonce":491345086}]},"public_addr":"172.21.15.170:6827/491345086","cluster_addr":"172.21.15.170:6829/491345086","heartbeat_back_addr":"172.21.15.170:6833/491345086","heartbeat_front_addr":"172.21.15.170:6831/491345086","state":["exists","up"]},{"osd":4,"uuid":"cfa93070-fbb3-4a03-9851-b695067b0966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6801","nonce":2343531836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6803","nonce":2343531836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6807","nonce":2343531836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6805","nonce":2343531836}]},"public_addr":"172.21.15.191:6801/2343531836","cluster_addr":"172.21.15.191:6803/2343531836","heartbeat_back_addr":"172.21.15.191:6807/2343531836","heartbeat_front_addr":"172.21.15.191:6805/2343531836","state":["exists","up"]},{"osd":5,"uuid":"2f54a25d-9950-4e6e-856a-2c43546542f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6809","nonce":1293651745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6811","nonce":1293651745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6815","nonce":1293651745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6813","nonce":1293651745}]},"public_addr":"172.21.15.191:6809/1293651745","cluster_addr":"172.21.15.191:6811/1293651745","heartbeat_back_addr":"172.21.15.191:6815/1293651745","heartbeat_front_addr":"172.21.15.191:6813/1293651745","state":["exists","up"]},{"osd":6,"uuid":"5f449900-d227-4293-95fd-4b2b0a143ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6817","nonce":161917649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6819","nonce":161917649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6823","nonce":161917649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6821","nonce":161917649}]},"public_addr":"172.21.15.191:6817/161917649","cluster_addr":"172.21.15.191:6819/161917649","heartbeat_back_addr":"172.21.15.191:6823/161917649","heartbeat_front_addr":"172.21.15.191:6821/161917649","state":["exists","up"]},{"osd":7,"uuid":"e10f3972-7269-4f69-be3d-8517b3a37a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6825","nonce":3124763648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6827","nonce":3124763648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6831","nonce":3124763648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6829","nonce":3124763648}]},"public_addr":"172.21.15.191:6825/3124763648","cluster_addr":"172.21.15.191:6827/3124763648","heartbeat_back_addr":"172.21.15.191:6831/3124763648","heartbeat_front_addr":"172.21.15.191:6829/3124763648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:29.032170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:51.350141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:15.530791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:40.815861+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:05.191915+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:29.157735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:53.210496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:13:18.384602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6801/2899305669":"2024-09-21T23:13:36.435975+0000","172.21.15.170:6800/2899305669":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/3538184848":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/23767874":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/2383773230":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/157478380":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/986208701":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6800/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/3220406731":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/2992658911":"2024-09-21T23:13:36.435975+0000","172.21.15.170:6800/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/292263619":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/4101521945":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/3118221257":"2024-09-21T23:08:41.281561+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T23:14:05.727 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 podman[41813]: 2024-09-20 23:14:05.340348685 +0000 UTC m=+2.771712340 container init 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:14:05.727 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 podman[41813]: 2024-09-20 23:14:05.343148491 +0000 UTC m=+2.774512142 container start 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:14:05.727 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.346Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=arp 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=bcache 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=bonding 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=btrfs 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=conntrack 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=cpu 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=diskstats 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=dmi 2024-09-20T23:14:05.728 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=edac 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.347Z caller=node_exporter.go:115 level=info collector=entropy 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=filefd 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=filesystem 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=hwmon 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=infiniband 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=ipvs 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=loadavg 2024-09-20T23:14:05.729 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=mdadm 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=meminfo 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=netclass 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=netdev 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=netstat 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=nfs 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=nfsd 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=nvme 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=os 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=pressure 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=rapl 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=schedstat 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=sockstat 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=softnet 2024-09-20T23:14:05.730 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=stat 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=tapestats 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=textfile 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=time 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=uname 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=vmstat 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=xfs 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:115 level=info collector=zfs 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[41888]: ts=2024-09-20T23:14:05.348Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 bash[41813]: 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 2024-09-20T23:14:05.731 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:14:05 smithi191 systemd[1]: Started Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:14:06.179 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-20T23:14:06.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T23:14:06.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[23733]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:06.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2965622759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:06.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:06.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[28691]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:06.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2965622759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:06.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:06 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:06.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:06 smithi191 ceph-mon[24760]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:06.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:06 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2965622759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:06.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:06 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:06.946 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:07.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:07 smithi191 ceph-mon[24760]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:14:07.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:07 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:07.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:07 smithi170 ceph-mon[23733]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:14:07.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:07 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:07.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:07 smithi170 ceph-mon[28691]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:14:07.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:07 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:08.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:08 smithi191 ceph-mon[24760]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:08 smithi170 ceph-mon[23733]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:08 smithi170 ceph-mon[28691]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:09.649 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:09] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:10.311 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:14:10.312 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":60,"fsid":"243152d6-77a5-11ef-baf5-efdc52797490","created":"2024-09-20T23:08:17.637812+0000","modified":"2024-09-20T23:13:36.436024+0000","last_up_change":"2024-09-20T23:13:20.308113+0000","last_in_change":"2024-09-20T23:13:01.983253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T23:11:18.809979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f3ce0997-6af3-4134-8516-f7e91b087e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6803","nonce":3598562870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6805","nonce":3598562870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6809","nonce":3598562870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3598562870},{"type":"v1","addr":"172.21.15.170:6807","nonce":3598562870}]},"public_addr":"172.21.15.170:6803/3598562870","cluster_addr":"172.21.15.170:6805/3598562870","heartbeat_back_addr":"172.21.15.170:6809/3598562870","heartbeat_front_addr":"172.21.15.170:6807/3598562870","state":["exists","up"]},{"osd":1,"uuid":"2ac7cfa7-2fc3-4aec-a4f1-9275838d4fa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6811","nonce":81196034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6813","nonce":81196034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6817","nonce":81196034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":81196034},{"type":"v1","addr":"172.21.15.170:6815","nonce":81196034}]},"public_addr":"172.21.15.170:6811/81196034","cluster_addr":"172.21.15.170:6813/81196034","heartbeat_back_addr":"172.21.15.170:6817/81196034","heartbeat_front_addr":"172.21.15.170:6815/81196034","state":["exists","up"]},{"osd":2,"uuid":"b49c0282-93c6-46d2-ba8a-2767884b07c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6819","nonce":2504239567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6821","nonce":2504239567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6825","nonce":2504239567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2504239567},{"type":"v1","addr":"172.21.15.170:6823","nonce":2504239567}]},"public_addr":"172.21.15.170:6819/2504239567","cluster_addr":"172.21.15.170:6821/2504239567","heartbeat_back_addr":"172.21.15.170:6825/2504239567","heartbeat_front_addr":"172.21.15.170:6823/2504239567","state":["exists","up"]},{"osd":3,"uuid":"f02cfafe-5ac9-48ce-90c2-65b02b4efc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6827","nonce":491345086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6829","nonce":491345086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6833","nonce":491345086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":491345086},{"type":"v1","addr":"172.21.15.170:6831","nonce":491345086}]},"public_addr":"172.21.15.170:6827/491345086","cluster_addr":"172.21.15.170:6829/491345086","heartbeat_back_addr":"172.21.15.170:6833/491345086","heartbeat_front_addr":"172.21.15.170:6831/491345086","state":["exists","up"]},{"osd":4,"uuid":"cfa93070-fbb3-4a03-9851-b695067b0966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6801","nonce":2343531836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6803","nonce":2343531836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6807","nonce":2343531836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2343531836},{"type":"v1","addr":"172.21.15.191:6805","nonce":2343531836}]},"public_addr":"172.21.15.191:6801/2343531836","cluster_addr":"172.21.15.191:6803/2343531836","heartbeat_back_addr":"172.21.15.191:6807/2343531836","heartbeat_front_addr":"172.21.15.191:6805/2343531836","state":["exists","up"]},{"osd":5,"uuid":"2f54a25d-9950-4e6e-856a-2c43546542f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6809","nonce":1293651745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6811","nonce":1293651745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6815","nonce":1293651745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1293651745},{"type":"v1","addr":"172.21.15.191:6813","nonce":1293651745}]},"public_addr":"172.21.15.191:6809/1293651745","cluster_addr":"172.21.15.191:6811/1293651745","heartbeat_back_addr":"172.21.15.191:6815/1293651745","heartbeat_front_addr":"172.21.15.191:6813/1293651745","state":["exists","up"]},{"osd":6,"uuid":"5f449900-d227-4293-95fd-4b2b0a143ae2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6817","nonce":161917649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6819","nonce":161917649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6823","nonce":161917649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":161917649},{"type":"v1","addr":"172.21.15.191:6821","nonce":161917649}]},"public_addr":"172.21.15.191:6817/161917649","cluster_addr":"172.21.15.191:6819/161917649","heartbeat_back_addr":"172.21.15.191:6823/161917649","heartbeat_front_addr":"172.21.15.191:6821/161917649","state":["exists","up"]},{"osd":7,"uuid":"e10f3972-7269-4f69-be3d-8517b3a37a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6825","nonce":3124763648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6827","nonce":3124763648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6831","nonce":3124763648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":3124763648},{"type":"v1","addr":"172.21.15.191:6829","nonce":3124763648}]},"public_addr":"172.21.15.191:6825/3124763648","cluster_addr":"172.21.15.191:6827/3124763648","heartbeat_back_addr":"172.21.15.191:6831/3124763648","heartbeat_front_addr":"172.21.15.191:6829/3124763648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:29.032170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:10:51.350141+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:15.530791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:11:40.815861+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:05.191915+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:29.157735+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:12:53.210496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T23:13:18.384602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6801/2899305669":"2024-09-21T23:13:36.435975+0000","172.21.15.170:6800/2899305669":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/3538184848":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/23767874":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/2383773230":"2024-09-21T23:13:36.435975+0000","172.21.15.170:0/157478380":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/986208701":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6800/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:0/3220406731":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/2992658911":"2024-09-21T23:13:36.435975+0000","172.21.15.170:6800/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/292263619":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/1240076329":"2024-09-21T23:09:04.455163+0000","172.21.15.170:6801/679696434":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/4101521945":"2024-09-21T23:08:41.281561+0000","172.21.15.170:0/3118221257":"2024-09-21T23:08:41.281561+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T23:14:10.575 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[28691]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:10.575 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:10.575 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1614918964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:10.576 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[23733]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:10.576 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:10.576 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1614918964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:10 smithi191 ceph-mon[24760]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:10 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1614918964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T23:14:10.900 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:14:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:11.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:11.728 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-20T23:14:11.729 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-20T23:14:11.729 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-20T23:14:11.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-20T23:14:11.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-20T23:14:11.731 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-20T23:14:11.731 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-20T23:14:11.731 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-20T23:14:11.833 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[28691]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:11.833 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.833 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.833 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.838 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[23733]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:11.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:11 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:11 smithi191 ceph-mon[24760]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:11 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:11 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:11 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:12.945 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.946 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.946 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.946 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.950 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.950 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:12.958 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:14.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[23733]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:14.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:14.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:14.114 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:14:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:14.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[28691]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:14.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:14.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:14 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:14 smithi191 ceph-mon[24760]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:14 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:14 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:16.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:16 smithi170 ceph-mon[23733]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:16.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:16 smithi170 ceph-mon[28691]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:16.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:16 smithi191 ceph-mon[24760]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:18.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:18 smithi170 ceph-mon[23733]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:18.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:18 smithi170 ceph-mon[28691]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:18.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:18 smithi191 ceph-mon[24760]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:20.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:20 smithi170 ceph-mon[28691]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:20.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:20 smithi191 ceph-mon[24760]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:20 smithi170 ceph-mon[23733]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:22.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:22 smithi170 ceph-mon[23733]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:22.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:22 smithi170 ceph-mon[28691]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:22.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:22 smithi191 ceph-mon[24760]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:24.129 INFO:teuthology.orchestra.run.smithi170.stdout:34359738415 2024-09-20T23:14:24.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-20T23:14:24.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:24 smithi170 ceph-mon[23733]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:24.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:24 smithi170 ceph-mon[28691]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:24.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:24 smithi191 ceph-mon[24760]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:24.890 INFO:teuthology.orchestra.run.smithi170.stdout:55834574893 2024-09-20T23:14:24.891 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-20T23:14:26.311 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:26 smithi170 ceph-mon[23733]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:26.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:26 smithi170 ceph-mon[28691]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:26.337 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:26 smithi191 ceph-mon[24760]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:27.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:27.918 INFO:teuthology.orchestra.run.smithi170.stdout:77309411368 2024-09-20T23:14:27.919 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-20T23:14:28.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:28 smithi191 ceph-mon[24760]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:28.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:28 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:28.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:28 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[23733]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:28.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[28691]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:28.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:28.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:28 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:29.258 INFO:teuthology.orchestra.run.smithi170.stdout:133143986205 2024-09-20T23:14:29.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-20T23:14:29.679 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:30 smithi191 ceph-mon[24760]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:30 smithi170 ceph-mon[23733]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:30 smithi170 ceph-mon[28691]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:32 smithi191 ceph-mon[24760]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:32 smithi170 ceph-mon[23733]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:32 smithi170 ceph-mon[28691]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:32.527 INFO:teuthology.orchestra.run.smithi170.stdout:167503724568 2024-09-20T23:14:32.527 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-20T23:14:34.015 INFO:teuthology.orchestra.run.smithi170.stdout:236223201296 2024-09-20T23:14:34.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-20T23:14:34.131 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:14:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[28691]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[23733]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:34 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:34 smithi191 ceph-mon[24760]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:34 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:34 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:34.496 INFO:teuthology.orchestra.run.smithi170.stdout:201863462932 2024-09-20T23:14:34.496 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-20T23:14:34.725 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:34 smithi170 podman[47076]: 2024-09-20 23:14:34.61470197 +0000 UTC m=+2.796045148 volume create 76f82771796ace570b51e91f8fb63bd89825f60f627344b06efd6cc9ae7fc0dd 2024-09-20T23:14:34.725 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:34 smithi170 podman[47076]: 2024-09-20 23:14:34.723543713 +0000 UTC m=+2.904886890 container create 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:35.415 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 podman[47076]: 2024-09-20 23:14:35.068963887 +0000 UTC m=+3.250307073 container init 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:35.415 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 podman[47076]: 2024-09-20 23:14:35.072244261 +0000 UTC m=+3.253587441 container start 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:14:35.415 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.082Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-09-20T23:14:35.415 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.082Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.083Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.170 port=9094 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.085Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.110Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.110Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.113Z caller=main.go:518 msg=Listening address=:9093 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:35.113Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 bash[47076]: 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd 2024-09-20T23:14:35.416 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:35 smithi170 systemd[1]: Started Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[23733]: Deploying daemon grafana.a on smithi191 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:36.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:36 smithi170 ceph-mon[28691]: Deploying daemon grafana.a on smithi191 2024-09-20T23:14:36.607 INFO:teuthology.orchestra.run.smithi170.stdout:55834574895 2024-09-20T23:14:36.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:36.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:14:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:36 smithi191 ceph-mon[24760]: Deploying daemon grafana.a on smithi191 2024-09-20T23:14:37.185 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:37.086Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000664902s 2024-09-20T23:14:37.249 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574893 got 55834574895 for osd.1 2024-09-20T23:14:37.250 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:37.846 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[23733]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:37.846 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:37.846 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:14:37.846 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:14:37.846 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1017822886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T23:14:37.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[28691]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:37.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:37.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:14:37.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:14:37.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1017822886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T23:14:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:37.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:37 smithi191 ceph-mon[24760]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:37.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:14:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:14:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:37 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1017822886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T23:14:38.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:14:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:38.399 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:38.399 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:38.401 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:38.405 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:38.437 INFO:teuthology.orchestra.run.smithi170.stdout:111669149731 2024-09-20T23:14:38.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-20T23:14:39.060 INFO:teuthology.orchestra.run.smithi170.stdout:77309411371 2024-09-20T23:14:39.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:38 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:38 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:39.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:38 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:39.664 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411368 got 77309411371 for osd.2 2024-09-20T23:14:39.664 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:39.708 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:14:40.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:40 smithi170 ceph-mon[23733]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:40.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:40 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2378753083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T23:14:40.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:40 smithi170 ceph-mon[28691]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:40.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:40 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2378753083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T23:14:40.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:40 smithi191 ceph-mon[24760]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:40.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:40 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2378753083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T23:14:42.219 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:42 smithi170 ceph-mon[23733]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:42.219 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:42 smithi170 ceph-mon[28691]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:42.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:42 smithi191 ceph-mon[24760]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:44.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:44 smithi191 ceph-mon[24760]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:44.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:44 smithi170 ceph-mon[23733]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:44.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:44 smithi170 ceph-mon[28691]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:45.243 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:14:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:14:45.088Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002766672s 2024-09-20T23:14:46.125 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-mon[24760]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:46.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:46 smithi170 ceph-mon[23733]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:46.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:46 smithi170 ceph-mon[28691]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:46.377 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 podman[42960]: 2024-09-20 23:14:46.372895498 +0000 UTC m=+0.362258990 container init 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, build-date=2022-03-28T10:36:18.413762, distribution-scope=public, release=236.1648460182, io.openshift.tags=base rhel8, description=Ceph Grafana Container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, vendor=Red Hat, Inc., name=ubi8, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, architecture=x86_64, io.openshift.expose-services=, com.redhat.component=ubi8-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-09-20T23:14:46.377 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 podman[42960]: 2024-09-20 23:14:46.37580003 +0000 UTC m=+0.365163495 container start 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, release=236.1648460182, distribution-scope=public, io.openshift.expose-services=, io.buildah.version=1.24.2, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, architecture=x86_64, version=8.5, com.redhat.component=ubi8-container, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, build-date=2022-03-28T10:36:18.413762) 2024-09-20T23:14:46.627 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-09-20T23:14:46.628 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="App mode production" logger=settings 2024-09-20T23:14:46.629 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-09-20T23:14:46.629 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-20T23:14:46.629 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-09-20T23:14:46.629 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-09-20T23:14:46.629 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-09-20T23:14:46.630 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-09-20T23:14:46.631 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-09-20T23:14:46.632 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-20T23:14:46.633 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 bash[42960]: 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-09-20T23:14:46.634 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 systemd[1]: Started Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-20T23:14:46.635 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-09-20T23:14:46.636 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-09-20T23:14:46.637 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-09-20T23:14:46.638 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-09-20T23:14:46.639 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-09-20T23:14:46.879 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-09-20T23:14:46.880 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-09-20T23:14:46.881 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-09-20T23:14:46.881 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-09-20T23:14:46.881 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-09-20T23:14:46.882 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-09-20T23:14:46.883 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-09-20T23:14:46.884 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-20T23:14:46.885 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-09-20T23:14:46.886 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-09-20T23:14:46.887 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-09-20T23:14:46.888 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-09-20T23:14:46.889 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-09-20T23:14:46.890 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-09-20T23:14:46.891 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-09-20T23:14:46.892 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-20T23:14:46.893 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-09-20T23:14:46.894 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-09-20T23:14:46.895 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-09-20T23:14:46.896 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-09-20T23:14:47.227 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-09-20T23:14:47.227 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-09-20T23:14:47.227 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-09-20T23:14:47.227 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-09-20T23:14:47.228 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-09-20T23:14:47.229 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-09-20T23:14:47.230 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=526.185866ms 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:46+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:47+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:47+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-20T23:14:47.231 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:47+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-09-20T23:14:47.232 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:47+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-09-20T23:14:47.232 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:14:47+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-09-20T23:14:47.308 INFO:teuthology.orchestra.run.smithi170.stdout:167503724571 2024-09-20T23:14:47.420 INFO:teuthology.orchestra.run.smithi170.stdout:133143986209 2024-09-20T23:14:47.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:14:47.941 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:14:47.941 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: Reconfiguring daemon alertmanager.a on smithi170 2024-09-20T23:14:47.941 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/658924243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T23:14:47.941 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.941 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:47 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1613968814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T23:14:47.991 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:47.991 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: Reconfiguring daemon alertmanager.a on smithi170 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/658924243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1613968814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T23:14:47.992 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: Reconfiguring daemon alertmanager.a on smithi170 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/658924243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:47 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1613968814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T23:14:48.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986205 got 133143986209 for osd.4 2024-09-20T23:14:48.018 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:49.248 INFO:teuthology.orchestra.run.smithi170.stdout:111669149735 2024-09-20T23:14:50.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:50 smithi170 ceph-mon[23733]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:50.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:50 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2462184823' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T23:14:50.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:50 smithi170 ceph-mon[28691]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:50.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:50 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2462184823' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T23:14:50.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:50 smithi191 ceph-mon[24760]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:50.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:50 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2462184823' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T23:14:50.607 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724568 got 167503724571 for osd.5 2024-09-20T23:14:50.607 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:51.002 INFO:teuthology.orchestra.run.smithi170.stdout:236223201300 2024-09-20T23:14:51.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:51 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4098846815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-20T23:14:51.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:51 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4098846815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-20T23:14:51.432 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:51 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4098846815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-20T23:14:52.207 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201296 got 236223201300 for osd.7 2024-09-20T23:14:52.208 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:52.323 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:52 smithi191 ceph-mon[24760]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:52.323 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:52 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:52.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:52 smithi170 ceph-mon[23733]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:52.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:52 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:52.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:52 smithi170 ceph-mon[28691]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:52.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:52 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:52.586 INFO:teuthology.orchestra.run.smithi170.stdout:201863462937 2024-09-20T23:14:52.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149731 got 111669149735 for osd.3 2024-09-20T23:14:52.854 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:53.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:53 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1588583348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-20T23:14:53.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:53 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1588583348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-20T23:14:53.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:53 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1588583348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-20T23:14:53.399 INFO:teuthology.orchestra.run.smithi170.stdout:34359738421 2024-09-20T23:14:53.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:53.952 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462932 got 201863462937 for osd.6 2024-09-20T23:14:53.953 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:54.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[23733]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:54.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/213214075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T23:14:54.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:54.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[28691]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:54.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/213214075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T23:14:54.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:54 smithi191 ceph-mon[24760]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:54 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/213214075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T23:14:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:54 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:54.639 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:14:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:55.053 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738415 got 34359738421 for osd.0 2024-09-20T23:14:55.054 DEBUG:teuthology.parallel:result is None 2024-09-20T23:14:55.054 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-20T23:14:55.054 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T23:14:55.478 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:55.478 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:14:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:14:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[23733]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[28691]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:55.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:55 smithi191 ceph-mon[24760]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:14:57.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:14:57 smithi170 ceph-mon[23733]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:57.820 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:14:57 smithi170 ceph-mon[28691]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:57.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:14:57 smithi191 ceph-mon[24760]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:14:58.502 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:15:00.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:00 smithi191 ceph-mon[24760]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:00.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:00 smithi170 ceph-mon[23733]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:00.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:00 smithi170 ceph-mon[28691]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:00.487 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:00 smithi170 systemd[1]: Stopping Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:15:00.487 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:00 smithi170 bash[48798]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager.a" found: no such container 2024-09-20T23:15:00.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[47309]: level=info ts=2024-09-20T23:15:00.656Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:15:01.169 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:00 smithi170 podman[48824]: 2024-09-20 23:15:00.886061535 +0000 UTC m=+0.796084058 container died 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:01.444 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 podman[48824]: 2024-09-20 23:15:01.325668548 +0000 UTC m=+1.235691070 container cleanup 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:01.444 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 bash[48824]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a 2024-09-20T23:15:01.444 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 bash[48899]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager.a" found: no such container 2024-09-20T23:15:01.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:15:01.560 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-09-20T23:15:01.729 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 podman[48875]: 2024-09-20 23:15:01.636026077 +0000 UTC m=+0.920954993 container remove 1eade5a53e8add3b543d798c0c6e639443d5fba9fdc50542b592e5ed517de0fd (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:01.729 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 podman[48875]: 2024-09-20 23:15:01.7280957 +0000 UTC m=+1.013024615 volume remove 76f82771796ace570b51e91f8fb63bd89825f60f627344b06efd6cc9ae7fc0dd 2024-09-20T23:15:01.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-20T23:15:01.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 systemd[1]: Stopped Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:15:01.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:01 smithi170 systemd[1]: Starting Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:15:02.349 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:02 smithi170 ceph-mon[23733]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:02.349 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:02 smithi170 ceph-mon[28691]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:02.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:02 smithi191 ceph-mon[24760]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:03.181 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-mon[23733]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:03.181 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:02 smithi170 podman[49019]: 2024-09-20 23:15:02.765486058 +0000 UTC m=+0.749931498 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-09-20T23:15:03.182 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-mon[28691]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:03.204 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-20T23:15:00.511335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48976,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912240,"statfs":{"total":767960285184,"available":767910133760,"internally_reserved":0,"allocated":6307840,"data_stored":3511476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002231"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":266,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-20T23:13:36.574661+0000","last_change":"2024-09-20T23:13:24.046473+0000","last_active":"2024-09-20T23:13:36.574661+0000","last_peered":"2024-09-20T23:13:36.574661+0000","last_clean":"2024-09-20T23:13:36.574661+0000","last_became_active":"2024-09-20T23:13:24.045941+0000","last_became_peered":"2024-09-20T23:13:24.045941+0000","last_unstale":"2024-09-20T23:13:36.574661+0000","last_undegraded":"2024-09-20T23:13:36.574661+0000","last_fullsized":"2024-09-20T23:13:36.574661+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T23:11:19.236703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T23:11:19.236703+0000","last_clean_scrub_stamp":"2024-09-20T23:11:19.236703+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:46.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.437},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.434},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.38}]},{"osd":4,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46800000000000003}]},{"osd":6,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.48099999999999998}]}]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":1118208,"data_stored":769265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.442},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.314},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 20 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52200000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Sep 20 23:14:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76400000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Sep 20 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 20 23:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.623},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 20 23:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.34699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.501,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.374}]},{"osd":2,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.439},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Sep 20 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.441},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.35599999999999998}]},{"osd":4,"last update":"Fri Sep 20 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Sep 20 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":17.146999999999998,"5min":17.146999999999998,"15min":17.146999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6280,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738872,"statfs":{"total":95995035648,"available":95988604928,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.498,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Sep 20 23:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.433,"15min":0.443},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 20 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Sep 20 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73099999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Sep 20 23:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71299999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149737,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.21299999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41499999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47799999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50900000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.37},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.45800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Sep 20 23:14:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 20 23:14:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.751,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.498},{"interface":"front","average":{"1min":1.4039999999999999,"5min":0.74199999999999999,"15min":0.63200000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.844000000000001,"5min":16.844000000000001,"15min":16.844000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Fri Sep 20 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.867000000000001,"5min":16.867000000000001,"15min":16.867000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55000000000000004}]}]},{"osd":4,"up_from":31,"seq":133143986212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":1.0329999999999999,"15min":1.117},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81299999999999994,"5min":12.555,"15min":12.555},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.443},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.505,"15min":0.498},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri Sep 20 23:14:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.35099999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.80000000000000004,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.248},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.68999999999999995,"15min":0.72899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64600000000000002,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.28000000000000003}]},{"osd":6,"last update":"Fri Sep 20 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999}]},{"osd":7,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.30599999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5700,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739452,"statfs":{"total":95995035648,"available":95989198848,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.626},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59699999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.579,"5min":0.747,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":17.658000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56299999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59499999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Sep 20 23:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.498},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T23:15:03.205 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T23:15:03.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:03 smithi191 ceph-mon[24760]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:03.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 podman[49019]: 2024-09-20 23:15:03.297257316 +0000 UTC m=+1.281702755 volume create 081782cb895ceb9654a31c688985654043300edca96553ac5bd435a5b6013e7e 2024-09-20T23:15:03.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 podman[49019]: 2024-09-20 23:15:03.389338092 +0000 UTC m=+1.373783531 container create 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:03.829 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:15:03.949 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 podman[49019]: 2024-09-20 23:15:03.700587149 +0000 UTC m=+1.685032595 container init 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:03.949 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 podman[49019]: 2024-09-20 23:15:03.703526746 +0000 UTC m=+1.687972185 container start 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:03.949 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.713Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-09-20T23:15:03.949 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.713Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.714Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.170 port=9094 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.715Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.740Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.740Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.742Z caller=main.go:518 msg=Listening address=:9093 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:03.742Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 bash[49019]: 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 2024-09-20T23:15:03.950 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:03 smithi170 systemd[1]: Started Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:15:04.184 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:04 smithi191 ceph-mon[24760]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:04.184 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:04 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:04 smithi170 ceph-mon[23733]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:04 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:04.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:04 smithi170 ceph-mon[28691]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:04.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:04 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:04.506 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[23733]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[23733]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[28691]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[28691]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:15:05.323 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:05.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:05 smithi191 ceph-mon[24760]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:15:05.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:05 smithi191 ceph-mon[24760]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:15:05.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:05.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:05.716Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000558733s 2024-09-20T23:15:06.393 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:06 smithi170 ceph-mon[28691]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:06.393 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:06 smithi170 ceph-mon[23733]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:06.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:06 smithi191 ceph-mon[24760]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:15:06.797 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-09-20T23:15:07.176 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:06 smithi191 systemd[1]: Stopping Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:15:07.176 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 bash[44012]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus.a" found: no such container 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[40926]: ts=2024-09-20T23:15:07.174Z caller=main.go:1066 level=info msg="See you next time!" 2024-09-20T23:15:07.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 podman[44024]: 2024-09-20 23:15:07.184446258 +0000 UTC m=+0.155137051 container died e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:07.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 podman[44024]: 2024-09-20 23:15:07.698874728 +0000 UTC m=+0.669565519 container cleanup e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:07.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 bash[44024]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a 2024-09-20T23:15:07.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 bash[44052]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus.a" found: no such container 2024-09-20T23:15:07.961 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-20T23:15:06.512485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48976,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912240,"statfs":{"total":767960285184,"available":767910133760,"internally_reserved":0,"allocated":6307840,"data_stored":3511476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002282"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":266,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-20T23:13:36.574661+0000","last_change":"2024-09-20T23:13:24.046473+0000","last_active":"2024-09-20T23:13:36.574661+0000","last_peered":"2024-09-20T23:13:36.574661+0000","last_clean":"2024-09-20T23:13:36.574661+0000","last_became_active":"2024-09-20T23:13:24.045941+0000","last_became_peered":"2024-09-20T23:13:24.045941+0000","last_unstale":"2024-09-20T23:13:36.574661+0000","last_undegraded":"2024-09-20T23:13:36.574661+0000","last_fullsized":"2024-09-20T23:13:36.574661+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T23:11:19.236703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T23:11:19.236703+0000","last_clean_scrub_stamp":"2024-09-20T23:11:19.236703+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:46.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.622}]},{"osd":6,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.505}]}]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":1118208,"data_stored":769265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.504}]},{"osd":1,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Sep 20 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.49099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.314},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Fri Sep 20 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52800000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52200000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Sep 20 23:14:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78900000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76400000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 20 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Sep 20 23:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.625},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 20 23:15:02 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40699999999999997,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Sep 20 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.441},"min":{"1min":0.307,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.372}]},{"osd":4,"last update":"Fri Sep 20 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.628},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Sep 20 23:14:58 2024","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":0.77100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":15.784000000000001,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":1.1839999999999999,"15min":1.276},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.28,"5min":17.146999999999998,"15min":17.146999999999998},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6280,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738872,"statfs":{"total":95995035648,"available":95988604928,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.498,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.31},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40699999999999997,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.432}]},{"osd":3,"last update":"Fri Sep 20 23:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.433,"15min":0.443},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.32400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Sep 20 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Sep 20 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73099999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Sep 20 23:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Sep 20 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55300000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.21299999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41499999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47799999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50900000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.371},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.45800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Sep 20 23:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Sep 20 23:14:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.621}]},{"osd":5,"last update":"Fri Sep 20 23:14:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.751,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.4039999999999999,"5min":0.74199999999999999,"15min":0.63200000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.844000000000001,"5min":16.844000000000001,"15min":16.844000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 20 23:15:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Sep 20 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.867000000000001,"5min":16.867000000000001,"15min":16.867000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58699999999999997}]}]},{"osd":4,"up_from":31,"seq":133143986213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":1.0329999999999999,"15min":1.117},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81299999999999994,"5min":12.555,"15min":12.555},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Sep 20 23:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.505,"15min":0.498},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Sep 20 23:14:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.35099999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.80000000000000004,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.68999999999999995,"15min":0.72899999999999998},"min":{"1min":0.34899999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64600000000000002,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Sep 20 23:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.47099999999999997},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.504,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67400000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5700,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739452,"statfs":{"total":95995035648,"available":95989198848,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59699999999999998,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66800000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.579,"5min":0.747,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":17.658000000000001,"5min":17.658000000000001,"15min":17.658000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 20 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56299999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59499999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.435}]},{"osd":6,"last update":"Fri Sep 20 23:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.53200000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71699999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Sep 20 23:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T23:15:07.962 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-20T23:15:07.962 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T23:15:07.962 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-20T23:15:07.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-20T23:15:08.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-mon[24760]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:08.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-mon[24760]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 podman[44035]: 2024-09-20 23:15:07.916676293 +0000 UTC m=+0.733372480 container remove e095c95afeadc693011033fdde10b19a1a71986b4739e6e2e2d684a0ceaa8cc4 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 systemd[1]: Stopped Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:07 smithi191 systemd[1]: Starting Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 podman[44115]: 2024-09-20 23:15:08.057445437 +0000 UTC m=+0.017833997 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-09-20T23:15:08.186 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 podman[44115]: 2024-09-20 23:15:08.184507649 +0000 UTC m=+0.144896277 container create df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:08 smithi170 ceph-mon[23733]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:08 smithi170 ceph-mon[23733]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:08 smithi170 ceph-mon[28691]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:08 smithi170 ceph-mon[28691]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T23:15:08.447 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 podman[44115]: 2024-09-20 23:15:08.419845532 +0000 UTC m=+0.380234089 container init df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:08.447 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 podman[44115]: 2024-09-20 23:15:08.422537879 +0000 UTC m=+0.382926435 container start df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:518 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi191 (none))" 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.446Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-20T23:15:08.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.447Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.448Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.449Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.451Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.451Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.57µs 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.451Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=35.51µs wal_replay_duration=1.570935ms total_replay_duration=1.630219ms 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=main.go:947 level=info msg="TSDB started" 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.453Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.469Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.869471ms db_storage=647ns remote_storage=1.407µs web_handler=310ns query_engine=643ns scrape=406.894µs scrape_sd=24.501µs notify=22.149µs notify_sd=9.521µs rules=15.148794ms 2024-09-20T23:15:08.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:15:08.469Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-09-20T23:15:08.729 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 bash[44115]: df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 2024-09-20T23:15:08.729 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:15:08 smithi191 systemd[1]: Started Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:15:09.717 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T23:15:09.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:09.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:09.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:09.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.170:9093"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:15:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.191:3000"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:11.660 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:11 smithi191 ceph-mon[24760]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:11.797 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:11 smithi170 ceph-mon[23733]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:11.797 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:11 smithi170 ceph-mon[28691]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:12.132 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-20T23:15:12.132 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T23:15:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:12 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/133361350' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T23:15:12.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:12 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/133361350' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T23:15:12.888 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:12 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/133361350' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T23:15:13.508 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-20T23:15:13.508 INFO:tasks.cephadm:Setup complete, yielding 2024-09-20T23:15:13.509 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T23:15:13.521 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:15:13.521 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-09-20T23:15:13.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:15:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:15:13.718Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003047281s 2024-09-20T23:15:14.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[23733]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:14.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:14.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:14.291 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:14.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[28691]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:14.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:14.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:14 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:14.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:14 smithi191 ceph-mon[24760]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:14.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:14 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:14.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:14 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:15.191 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:15.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:15.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:15.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:15.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:15.446 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:15 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:15:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:16.528 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T23:15:16.542 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:15:16.543 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:15:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:16.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:16.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:16.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' 2024-09-20T23:15:16.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:16.669 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:16.669 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:17 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:17 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:17 smithi191 ceph-mon[24760]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[23733]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:17 smithi170 ceph-mon[28691]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:18.773 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:19.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:18] "GET /metrics HTTP/1.1" 200 191501 "" "Prometheus/2.33.4" 2024-09-20T23:15:19.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: osdmap e61: 8 total, 8 up, 8 in 2024-09-20T23:15:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2284967525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:19 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: osdmap e61: 8 total, 8 up, 8 in 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2284967525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: osdmap e61: 8 total, 8 up, 8 in 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2284967525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:19.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:19 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T23:15:20.099 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:15:20.100 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "505c931a-22b5-4cf0-bbdf-e1c6d3207e5b", 2024-09-20T23:15:20.100 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "r", 2024-09-20T23:15:20.100 INFO:teuthology.orchestra.run.smithi170.stdout: "current_period": "23652e5d-6601-450c-b465-aab081cf5434", 2024-09-20T23:15:20.100 INFO:teuthology.orchestra.run.smithi170.stdout: "epoch": 1 2024-09-20T23:15:20.100 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:15:20.825 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-09-20T23:15:20.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:15:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:15:21.069 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:21 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T23:15:21.069 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:21 smithi170 ceph-mon[23733]: osdmap e62: 8 total, 8 up, 8 in 2024-09-20T23:15:21.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:21 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T23:15:21.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:21 smithi170 ceph-mon[28691]: osdmap e62: 8 total, 8 up, 8 in 2024-09-20T23:15:21.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:21 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T23:15:21.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:21 smithi191 ceph-mon[24760]: osdmap e62: 8 total, 8 up, 8 in 2024-09-20T23:15:22.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:22 smithi170 ceph-mon[23733]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:22.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:22 smithi170 ceph-mon[23733]: osdmap e63: 8 total, 8 up, 8 in 2024-09-20T23:15:22.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:22 smithi170 ceph-mon[28691]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:22.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:22 smithi170 ceph-mon[28691]: osdmap e63: 8 total, 8 up, 8 in 2024-09-20T23:15:22.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:22 smithi191 ceph-mon[24760]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:22.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:22 smithi191 ceph-mon[24760]: osdmap e63: 8 total, 8 up, 8 in 2024-09-20T23:15:22.554 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:15:22.554 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "ddc3f7c4-f5ef-4a34-982b-10fdebc778a9", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "api_name": "default", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "is_master": "true", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "endpoints": [], 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "hostnames": [], 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "hostnames_s3website": [], 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "master_zone": "", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "zones": [], 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "placement_targets": [], 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "default_placement": "", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_id": "505c931a-22b5-4cf0-bbdf-e1c6d3207e5b", 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "sync_policy": { 2024-09-20T23:15:22.555 INFO:teuthology.orchestra.run.smithi170.stdout: "groups": [] 2024-09-20T23:15:22.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:22.556 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:15:24.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:24 smithi170 ceph-mon[23733]: pgmap v59: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:24.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:24 smithi170 ceph-mon[28691]: pgmap v59: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:24.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:24 smithi191 ceph-mon[24760]: pgmap v59: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:15:24.819 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-09-20T23:15:26.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:26 smithi170 ceph-mon[23733]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-20T23:15:26.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:26 smithi170 ceph-mon[28691]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-20T23:15:26.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:26 smithi191 ceph-mon[24760]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "fe0f63fe-c0cc-4dae-86af-727eb2bfe6d4", 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "z", 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout: "domain_root": "z.rgw.meta:root", 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout: "control_pool": "z.rgw.control", 2024-09-20T23:15:27.235 INFO:teuthology.orchestra.run.smithi170.stdout: "gc_pool": "z.rgw.log:gc", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "lc_pool": "z.rgw.log:lc", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "log_pool": "z.rgw.log", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "roles_pool": "z.rgw.meta:roles", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "otp_pool": "z.rgw.otp", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "system_key": { 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "access_key": "", 2024-09-20T23:15:27.236 INFO:teuthology.orchestra.run.smithi170.stdout: "secret_key": "" 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "placement_pools": [ 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "key": "default-placement", 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "val": { 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "index_pool": "z.rgw.buckets.index", 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "storage_classes": { 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "STANDARD": { 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "data_pool": "z.rgw.buckets.data" 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: "index_type": 0 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:27.237 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:15:27.238 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_id": "505c931a-22b5-4cf0-bbdf-e1c6d3207e5b", 2024-09-20T23:15:27.238 INFO:teuthology.orchestra.run.smithi170.stdout: "notif_pool": "z.rgw.log:notif" 2024-09-20T23:15:27.238 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:15:27.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-09-20T23:15:28.209 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:28 smithi170 ceph-mon[23733]: pgmap v61: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-20T23:15:28.210 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:28 smithi170 ceph-mon[28691]: pgmap v61: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-20T23:15:28.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:28 smithi191 ceph-mon[24760]: pgmap v61: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-20T23:15:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:28] "GET /metrics HTTP/1.1" 200 192556 "" "Prometheus/2.33.4" 2024-09-20T23:15:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:30 smithi191 ceph-mon[24760]: pgmap v62: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-09-20T23:15:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:30 smithi170 ceph-mon[23733]: pgmap v62: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-09-20T23:15:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:30 smithi170 ceph-mon[28691]: pgmap v62: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-09-20T23:15:30.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:15:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:15:31.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:31 smithi191 ceph-mon[24760]: osdmap e64: 8 total, 8 up, 8 in 2024-09-20T23:15:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:31 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:31 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[23733]: osdmap e64: 8 total, 8 up, 8 in 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[28691]: osdmap e64: 8 total, 8 up, 8 in 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:31 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-20T23:15:32.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:32 smithi191 ceph-mon[24760]: pgmap v64: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 758 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-20T23:15:32.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:32 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-20T23:15:32.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:32 smithi191 ceph-mon[24760]: osdmap e65: 8 total, 8 up, 8 in 2024-09-20T23:15:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[23733]: pgmap v64: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 758 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-20T23:15:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-20T23:15:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[23733]: osdmap e65: 8 total, 8 up, 8 in 2024-09-20T23:15:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[28691]: pgmap v64: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 758 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-20T23:15:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-20T23:15:32.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-mon[28691]: osdmap e65: 8 total, 8 up, 8 in 2024-09-20T23:15:32.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:15:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:33.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:33 smithi191 ceph-mon[24760]: osdmap e66: 8 total, 8 up, 8 in 2024-09-20T23:15:33.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:33 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:33 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:33 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:33.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:33 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[23733]: osdmap e66: 8 total, 8 up, 8 in 2024-09-20T23:15:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[28691]: osdmap e66: 8 total, 8 up, 8 in 2024-09-20T23:15:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2049973058' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-20T23:15:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:33 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:34 smithi191 ceph-mon[24760]: pgmap v67: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-09-20T23:15:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:34 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-20T23:15:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:34 smithi191 ceph-mon[24760]: osdmap e67: 8 total, 8 up, 8 in 2024-09-20T23:15:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[23733]: pgmap v67: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-09-20T23:15:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-20T23:15:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[23733]: osdmap e67: 8 total, 8 up, 8 in 2024-09-20T23:15:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[28691]: pgmap v67: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-09-20T23:15:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-20T23:15:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:34 smithi170 ceph-mon[28691]: osdmap e67: 8 total, 8 up, 8 in 2024-09-20T23:15:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:35 smithi191 ceph-mon[24760]: osdmap e68: 8 total, 8 up, 8 in 2024-09-20T23:15:35.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:35 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T23:15:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:35 smithi170 ceph-mon[23733]: osdmap e68: 8 total, 8 up, 8 in 2024-09-20T23:15:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:35 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T23:15:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:35 smithi170 ceph-mon[28691]: osdmap e68: 8 total, 8 up, 8 in 2024-09-20T23:15:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:35 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T23:15:36.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:36 smithi191 ceph-mon[24760]: pgmap v70: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:36 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-20T23:15:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:36 smithi191 ceph-mon[24760]: osdmap e69: 8 total, 8 up, 8 in 2024-09-20T23:15:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:36 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[23733]: pgmap v70: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[23733]: osdmap e69: 8 total, 8 up, 8 in 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[28691]: pgmap v70: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[28691]: osdmap e69: 8 total, 8 up, 8 in 2024-09-20T23:15:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:36 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "945c75e3-aee3-4a5a-9ada-a3ed5802f195", 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "epoch": 1, 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "predecessor_uuid": "23652e5d-6601-450c-b465-aab081cf5434", 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "sync_status": [], 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "period_map": { 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "945c75e3-aee3-4a5a-9ada-a3ed5802f195", 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "zonegroups": [ 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "ddc3f7c4-f5ef-4a34-982b-10fdebc778a9", 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default", 2024-09-20T23:15:37.172 INFO:teuthology.orchestra.run.smithi170.stdout: "api_name": "default", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "is_master": "true", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "endpoints": [], 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "hostnames": [], 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "hostnames_s3website": [], 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "master_zone": "fe0f63fe-c0cc-4dae-86af-727eb2bfe6d4", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "zones": [ 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "id": "fe0f63fe-c0cc-4dae-86af-727eb2bfe6d4", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "z", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "endpoints": [], 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "log_meta": "false", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "log_data": "false", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "bucket_index_max_shards": 11, 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "read_only": "false", 2024-09-20T23:15:37.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tier_type": "", 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "sync_from_all": "true", 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "sync_from": [], 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect_zone": "" 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "placement_targets": [ 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default-placement", 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "storage_classes": [ 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "STANDARD" 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:15:37.174 INFO:teuthology.orchestra.run.smithi170.stdout: "default_placement": "default-placement", 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_id": "505c931a-22b5-4cf0-bbdf-e1c6d3207e5b", 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "sync_policy": { 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "groups": [] 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "short_zone_ids": [ 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "key": "fe0f63fe-c0cc-4dae-86af-727eb2bfe6d4", 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 1164886618 2024-09-20T23:15:37.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "master_zonegroup": "ddc3f7c4-f5ef-4a34-982b-10fdebc778a9", 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "master_zone": "fe0f63fe-c0cc-4dae-86af-727eb2bfe6d4", 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "period_config": { 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "bucket_quota": { 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": false, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "check_on_raw": false, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "max_size": -1, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "max_size_kb": 0, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "max_objects": -1 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "user_quota": { 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": false, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "check_on_raw": false, 2024-09-20T23:15:37.176 INFO:teuthology.orchestra.run.smithi170.stdout: "max_size": -1, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_size_kb": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_objects": -1 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "user_ratelimit": { 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_ops": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_ops": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_bytes": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_bytes": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": false 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "bucket_ratelimit": { 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_ops": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_ops": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_bytes": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_bytes": 0, 2024-09-20T23:15:37.177 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": false 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "anonymous_ratelimit": { 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_ops": 0, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_ops": 0, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "max_read_bytes": 0, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "max_write_bytes": 0, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": false 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_id": "505c931a-22b5-4cf0-bbdf-e1c6d3207e5b", 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_name": "r", 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout: "realm_epoch": 2 2024-09-20T23:15:37.178 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: osdmap e70: 8 total, 8 up, 8 in 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-20T23:15:37.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[23733]: osdmap e71: 8 total, 8 up, 8 in 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: osdmap e70: 8 total, 8 up, 8 in 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-20T23:15:37.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:37 smithi170 ceph-mon[28691]: osdmap e71: 8 total, 8 up, 8 in 2024-09-20T23:15:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: osdmap e70: 8 total, 8 up, 8 in 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2446714236' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-20T23:15:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:37 smithi191 ceph-mon[24760]: osdmap e71: 8 total, 8 up, 8 in 2024-09-20T23:15:37.927 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-09-20T23:15:38.239 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:38 smithi170 ceph-mon[23733]: pgmap v73: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:38.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:38 smithi170 ceph-mon[28691]: pgmap v73: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:38 smithi191 ceph-mon[24760]: pgmap v73: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-20T23:15:39.238 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:38] "GET /metrics HTTP/1.1" 200 196526 "" "Prometheus/2.33.4" 2024-09-20T23:15:39.238 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:39.901 INFO:teuthology.orchestra.run.smithi170.stdout:Scheduled rgw.foo update... 2024-09-20T23:15:39.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[23733]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-20T23:15:39.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:39.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:39.901 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[28691]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-20T23:15:39.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:39.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:39 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:39 smithi191 ceph-mon[24760]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-20T23:15:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:39 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:39 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:40 smithi191 ceph-mon[24760]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:15:41.230 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.231 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[23733]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: Saving service rgw.foo spec with placement count:2 2024-09-20T23:15:41.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:41.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:41.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:41.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:41.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:40 smithi170 ceph-mon[28691]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:15:41.676 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch apply rgw smpl' 2024-09-20T23:15:41.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:41 smithi170 ceph-mon[23733]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-20T23:15:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:41 smithi191 ceph-mon[24760]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-20T23:15:42.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:41 smithi170 ceph-mon[28691]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-20T23:15:44.376 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:44 smithi170 ceph-mon[28691]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-20T23:15:44.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:44 smithi170 ceph-mon[23733]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-20T23:15:44.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:44 smithi191 ceph-mon[24760]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-20T23:15:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:Scheduled rgw.smpl update... 2024-09-20T23:15:45.593 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph osd pool create foo' 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-20T23:15:46.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:46.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:46.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:46 smithi170 ceph-mon[23733]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:15:46.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:46 smithi170 ceph-mon[28691]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:15:47.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:46 smithi191 ceph-mon[24760]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:15:47.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:47 smithi170 ceph-mon[23733]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-09-20T23:15:47.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:47 smithi170 ceph-mon[28691]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-09-20T23:15:48.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:47 smithi191 ceph-mon[24760]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-09-20T23:15:49.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:48] "GET /metrics HTTP/1.1" 200 196526 "" "Prometheus/2.33.4" 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/845664872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/845664872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:49 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/845664872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-20T23:15:49.641 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:49.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:49.642 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:49 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:49.811 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'foo' created 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: pgmap v80: 129 pgs: 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 3.7 KiB/s wr, 100 op/s 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[28691]: osdmap e72: 8 total, 8 up, 8 in 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: pgmap v80: 129 pgs: 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 3.7 KiB/s wr, 100 op/s 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-20T23:15:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:50 smithi170 ceph-mon[23733]: osdmap e72: 8 total, 8 up, 8 in 2024-09-20T23:15:50.657 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: pgmap v80: 129 pgs: 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 3.7 KiB/s wr, 100 op/s 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: Checking dashboard <-> RGW credentials 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-20T23:15:50.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-mon[24760]: osdmap e72: 8 total, 8 up, 8 in 2024-09-20T23:15:50.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:15:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:15:51.881 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'rbd pool init foo' 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[23733]: pgmap v82: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.3 KiB/s wr, 112 op/s 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[23733]: osdmap e73: 8 total, 8 up, 8 in 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[28691]: pgmap v82: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.3 KiB/s wr, 112 op/s 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[28691]: osdmap e73: 8 total, 8 up, 8 in 2024-09-20T23:15:52.183 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:51 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:52.197 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:51 smithi191 ceph-mon[24760]: pgmap v82: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.3 KiB/s wr, 112 op/s 2024-09-20T23:15:52.197 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:51 smithi191 ceph-mon[24760]: osdmap e73: 8 total, 8 up, 8 in 2024-09-20T23:15:52.197 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:51 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:52.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:15:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:53.064 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-mon[23733]: osdmap e74: 8 total, 8 up, 8 in 2024-09-20T23:15:53.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:53.065 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:53.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-mon[28691]: osdmap e74: 8 total, 8 up, 8 in 2024-09-20T23:15:53.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:52 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:53.126 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:52 smithi191 ceph-mon[24760]: osdmap e74: 8 total, 8 up, 8 in 2024-09-20T23:15:53.126 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:52 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:54.168 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:53 smithi170 ceph-mon[28691]: pgmap v85: 161 pgs: 14 unknown, 147 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 5.7 KiB/s wr, 271 op/s 2024-09-20T23:15:54.168 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:53 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:54.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:53 smithi170 ceph-mon[23733]: pgmap v85: 161 pgs: 14 unknown, 147 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 5.7 KiB/s wr, 271 op/s 2024-09-20T23:15:54.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:53 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:54.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:53 smithi191 ceph-mon[24760]: pgmap v85: 161 pgs: 14 unknown, 147 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 5.7 KiB/s wr, 271 op/s 2024-09-20T23:15:54.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:53 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:55.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:15:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:55.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:56.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:15:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:15:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4243785726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4243785726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:56.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:56.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:56.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4243785726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[23733]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[23733]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[23733]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[23733]: osdmap e75: 8 total, 8 up, 8 in 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[28691]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[28691]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:15:57.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[28691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-20T23:15:57.428 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:57 smithi170 ceph-mon[28691]: osdmap e75: 8 total, 8 up, 8 in 2024-09-20T23:15:57.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:57 smithi191 ceph-mon[24760]: Saving service rgw.smpl spec with placement count:2 2024-09-20T23:15:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:57 smithi191 ceph-mon[24760]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:15:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:57 smithi191 ceph-mon[24760]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-20T23:15:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:57 smithi191 ceph-mon[24760]: osdmap e75: 8 total, 8 up, 8 in 2024-09-20T23:15:58.325 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:58 smithi170 ceph-mon[23733]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:58.325 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:58 smithi170 ceph-mon[23733]: osdmap e76: 8 total, 8 up, 8 in 2024-09-20T23:15:58.325 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:58 smithi170 ceph-mon[28691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:58.325 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:58 smithi170 ceph-mon[28691]: osdmap e76: 8 total, 8 up, 8 in 2024-09-20T23:15:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:58 smithi191 ceph-mon[24760]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 511 B/s wr, 179 op/s 2024-09-20T23:15:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:58 smithi191 ceph-mon[24760]: osdmap e76: 8 total, 8 up, 8 in 2024-09-20T23:15:58.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:15:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:15:58] "GET /metrics HTTP/1.1" 200 207089 "" "Prometheus/2.33.4" 2024-09-20T23:15:59.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch apply iscsi foo u p' 2024-09-20T23:15:59.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: osdmap e77: 8 total, 8 up, 8 in 2024-09-20T23:15:59.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:59.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 511 B/s wr, 95 op/s 2024-09-20T23:15:59.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[23733]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: osdmap e77: 8 total, 8 up, 8 in 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 511 B/s wr, 95 op/s 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:59.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:15:59 smithi170 ceph-mon[28691]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: osdmap e77: 8 total, 8 up, 8 in 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 511 B/s wr, 95 op/s 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:15:59 smithi191 ceph-mon[24760]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:16:00.871 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:01.099 INFO:teuthology.orchestra.run.smithi170.stdout:Scheduled iscsi.foo update... 2024-09-20T23:16:01.762 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'sleep 120' 2024-09-20T23:16:02.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-09-20T23:16:02.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: Saving service iscsi.foo spec with placement count:1 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:02 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.359 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-09-20T23:16:02.359 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.359 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.359 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.359 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: Saving service iscsi.foo spec with placement count:1 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.360 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: Saving service iscsi.foo spec with placement count:1 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: Checking dashboard <-> RGW credentials 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:02.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:02 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:03.346 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:03 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:03.346 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:04.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:04 smithi191 ceph-mon[24760]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 186 KiB/s rd, 679 B/s wr, 282 op/s 2024-09-20T23:16:04.230 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:04 smithi170 ceph-mon[23733]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 186 KiB/s rd, 679 B/s wr, 282 op/s 2024-09-20T23:16:04.231 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:04 smithi170 ceph-mon[28691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 186 KiB/s rd, 679 B/s wr, 282 op/s 2024-09-20T23:16:05.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:16:05] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:06.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:06 smithi170 ceph-mon[23733]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 171 KiB/s rd, 511 B/s wr, 260 op/s 2024-09-20T23:16:06.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:06 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:06.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:06 smithi170 ceph-mon[28691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 171 KiB/s rd, 511 B/s wr, 260 op/s 2024-09-20T23:16:06.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:06 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:06.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:06 smithi191 ceph-mon[24760]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 171 KiB/s rd, 511 B/s wr, 260 op/s 2024-09-20T23:16:06.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:06 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:07.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:07.863 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:16:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[23733]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 453 B/s wr, 230 op/s 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[28691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 453 B/s wr, 230 op/s 2024-09-20T23:16:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:07 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:07 smithi191 ceph-mon[24760]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 453 B/s wr, 230 op/s 2024-09-20T23:16:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:07 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:07 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:08.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:07 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:09.069 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:08] "GET /metrics HTTP/1.1" 200 214887 "" "Prometheus/2.33.4" 2024-09-20T23:16:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:09 smithi191 ceph-mon[24760]: osdmap e78: 8 total, 8 up, 8 in 2024-09-20T23:16:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:09 smithi170 ceph-mon[23733]: osdmap e78: 8 total, 8 up, 8 in 2024-09-20T23:16:09.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:09] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:09 smithi170 ceph-mon[28691]: osdmap e78: 8 total, 8 up, 8 in 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: Checking pool "foo" exists for service iscsi.foo 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:16:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-20T23:16:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-mon[24760]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:16:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: Checking pool "foo" exists for service iscsi.foo 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[28691]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: Checking pool "foo" exists for service iscsi.foo 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:10.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:10 smithi170 ceph-mon[23733]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:16:10.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-20T23:16:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:12 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:12.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:12.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:12.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:12.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:12.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:12.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:12 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:13.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:13.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: Adding iSCSI gateway http://:@172.21.15.170:5000 to Dashboard 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/162604388' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]: dispatch 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: Adding iSCSI gateway http://:@172.21.15.170:5000 to Dashboard 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/162604388' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:16:13.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]: dispatch 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: Adding iSCSI gateway http://:@172.21.15.170:5000 to Dashboard 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi170"}]: dispatch 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/162604388' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:16:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]: dispatch 2024-09-20T23:16:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:14 smithi191 ceph-mon[24760]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 102 B/s wr, 38 op/s 2024-09-20T23:16:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:14 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]': finished 2024-09-20T23:16:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:14 smithi191 ceph-mon[24760]: osdmap e79: 8 total, 8 up, 8 in 2024-09-20T23:16:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:14 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]: dispatch 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[23733]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 102 B/s wr, 38 op/s 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]': finished 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[23733]: osdmap e79: 8 total, 8 up, 8 in 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]: dispatch 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[28691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 102 B/s wr, 38 op/s 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2515488321' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2899305669"}]': finished 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[28691]: osdmap e79: 8 total, 8 up, 8 in 2024-09-20T23:16:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:14 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]: dispatch 2024-09-20T23:16:15.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:15 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]': finished 2024-09-20T23:16:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:15 smithi191 ceph-mon[24760]: osdmap e80: 8 total, 8 up, 8 in 2024-09-20T23:16:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:15 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1493479991' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:15 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]': finished 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[23733]: osdmap e80: 8 total, 8 up, 8 in 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1493479991' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3117957864' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2899305669"}]': finished 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[28691]: osdmap e80: 8 total, 8 up, 8 in 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1493479991' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]: dispatch 2024-09-20T23:16:15.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:15 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:16.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:16 smithi191 ceph-mon[24760]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 158 B/s rd, 158 B/s wr, 1 op/s 2024-09-20T23:16:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:16 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]': finished 2024-09-20T23:16:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:16 smithi191 ceph-mon[24760]: osdmap e81: 8 total, 8 up, 8 in 2024-09-20T23:16:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:16 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]: dispatch 2024-09-20T23:16:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[23733]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 158 B/s rd, 158 B/s wr, 1 op/s 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]': finished 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[23733]: osdmap e81: 8 total, 8 up, 8 in 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]: dispatch 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[28691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 158 B/s rd, 158 B/s wr, 1 op/s 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3538184848"}]': finished 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[28691]: osdmap e81: 8 total, 8 up, 8 in 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]: dispatch 2024-09-20T23:16:16.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:17.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:17 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]': finished 2024-09-20T23:16:17.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:17 smithi191 ceph-mon[24760]: osdmap e82: 8 total, 8 up, 8 in 2024-09-20T23:16:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:17 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]: dispatch 2024-09-20T23:16:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:17 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]': finished 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[23733]: osdmap e82: 8 total, 8 up, 8 in 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]: dispatch 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/350509093' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/23767874"}]': finished 2024-09-20T23:16:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[28691]: osdmap e82: 8 total, 8 up, 8 in 2024-09-20T23:16:17.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]: dispatch 2024-09-20T23:16:17.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:17 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:18.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:18 smithi191 ceph-mon[24760]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:18.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:18 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]': finished 2024-09-20T23:16:18.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:18 smithi191 ceph-mon[24760]: osdmap e83: 8 total, 8 up, 8 in 2024-09-20T23:16:18.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:18 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]: dispatch 2024-09-20T23:16:18.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[23733]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]': finished 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[23733]: osdmap e83: 8 total, 8 up, 8 in 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]: dispatch 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[28691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3618780399' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2383773230"}]': finished 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[28691]: osdmap e83: 8 total, 8 up, 8 in 2024-09-20T23:16:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]: dispatch 2024-09-20T23:16:18.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:18] "GET /metrics HTTP/1.1" 200 214887 "" "Prometheus/2.33.4" 2024-09-20T23:16:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]': finished 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: osdmap e84: 8 total, 8 up, 8 in 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:19 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]: dispatch 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]': finished 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: osdmap e84: 8 total, 8 up, 8 in 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]: dispatch 2024-09-20T23:16:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1046387012' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/157478380"}]': finished 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: osdmap e84: 8 total, 8 up, 8 in 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:19.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:19 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]: dispatch 2024-09-20T23:16:20.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-mon[24760]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:20.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]': finished 2024-09-20T23:16:20.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-mon[24760]: osdmap e85: 8 total, 8 up, 8 in 2024-09-20T23:16:20.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1175487691' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[23733]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]': finished 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[23733]: osdmap e85: 8 total, 8 up, 8 in 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1175487691' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[28691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/100655715' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/986208701"}]': finished 2024-09-20T23:16:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[28691]: osdmap e85: 8 total, 8 up, 8 in 2024-09-20T23:16:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1175487691' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:20 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]: dispatch 2024-09-20T23:16:20.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]': finished 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[28691]: osdmap e86: 8 total, 8 up, 8 in 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[28691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]: dispatch 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]': finished 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[23733]: osdmap e86: 8 total, 8 up, 8 in 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[23733]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:21 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]: dispatch 2024-09-20T23:16:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:21 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/1240076329"}]': finished 2024-09-20T23:16:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:21 smithi191 ceph-mon[24760]: osdmap e86: 8 total, 8 up, 8 in 2024-09-20T23:16:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:21 smithi191 ceph-mon[24760]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:21 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]: dispatch 2024-09-20T23:16:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]': finished 2024-09-20T23:16:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[23733]: osdmap e87: 8 total, 8 up, 8 in 2024-09-20T23:16:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]: dispatch 2024-09-20T23:16:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]': finished 2024-09-20T23:16:22.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[28691]: osdmap e87: 8 total, 8 up, 8 in 2024-09-20T23:16:22.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]: dispatch 2024-09-20T23:16:22.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:22 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1230450669' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3220406731"}]': finished 2024-09-20T23:16:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:22 smithi191 ceph-mon[24760]: osdmap e87: 8 total, 8 up, 8 in 2024-09-20T23:16:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]: dispatch 2024-09-20T23:16:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:22 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:23.693 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:23 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]': finished 2024-09-20T23:16:23.693 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:23 smithi191 ceph-mon[24760]: osdmap e88: 8 total, 8 up, 8 in 2024-09-20T23:16:23.693 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:23 smithi191 ceph-mon[24760]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:23.693 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:23 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]: dispatch 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]': finished 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[23733]: osdmap e88: 8 total, 8 up, 8 in 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[23733]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]: dispatch 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2022672839' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2992658911"}]': finished 2024-09-20T23:16:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[28691]: osdmap e88: 8 total, 8 up, 8 in 2024-09-20T23:16:23.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[28691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:23.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:23 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]: dispatch 2024-09-20T23:16:24.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:16:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:24.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]': finished 2024-09-20T23:16:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: osdmap e89: 8 total, 8 up, 8 in 2024-09-20T23:16:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3939724143' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:24 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]': finished 2024-09-20T23:16:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: osdmap e89: 8 total, 8 up, 8 in 2024-09-20T23:16:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3939724143' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1375490515' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/679696434"}]': finished 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: osdmap e89: 8 total, 8 up, 8 in 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3939724143' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]: dispatch 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:24 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:25 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]': finished 2024-09-20T23:16:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:25 smithi191 ceph-mon[24760]: osdmap e90: 8 total, 8 up, 8 in 2024-09-20T23:16:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:25 smithi191 ceph-mon[24760]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:25 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/94072137' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:25 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]': finished 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[23733]: osdmap e90: 8 total, 8 up, 8 in 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[23733]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/94072137' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/292263619"}]': finished 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[28691]: osdmap e90: 8 total, 8 up, 8 in 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[28691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/94072137' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:25 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]: dispatch 2024-09-20T23:16:26.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:26 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]': finished 2024-09-20T23:16:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:26 smithi191 ceph-mon[24760]: osdmap e91: 8 total, 8 up, 8 in 2024-09-20T23:16:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:26 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/129180558' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:26 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]': finished 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[23733]: osdmap e91: 8 total, 8 up, 8 in 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/129180558' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/1240076329"}]': finished 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[28691]: osdmap e91: 8 total, 8 up, 8 in 2024-09-20T23:16:26.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/129180558' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:26.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:26 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]: dispatch 2024-09-20T23:16:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:27 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]': finished 2024-09-20T23:16:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:27 smithi191 ceph-mon[24760]: osdmap e92: 8 total, 8 up, 8 in 2024-09-20T23:16:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:27 smithi191 ceph-mon[24760]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:27 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]: dispatch 2024-09-20T23:16:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]': finished 2024-09-20T23:16:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[23733]: osdmap e92: 8 total, 8 up, 8 in 2024-09-20T23:16:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[23733]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]: dispatch 2024-09-20T23:16:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/679696434"}]': finished 2024-09-20T23:16:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[28691]: osdmap e92: 8 total, 8 up, 8 in 2024-09-20T23:16:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[28691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:16:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:27 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]: dispatch 2024-09-20T23:16:28.800 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]': finished 2024-09-20T23:16:28.801 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[23733]: osdmap e93: 8 total, 8 up, 8 in 2024-09-20T23:16:28.801 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]: dispatch 2024-09-20T23:16:28.801 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]': finished 2024-09-20T23:16:28.801 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[28691]: osdmap e93: 8 total, 8 up, 8 in 2024-09-20T23:16:28.801 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]: dispatch 2024-09-20T23:16:28.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:28 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/841992729' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/4101521945"}]': finished 2024-09-20T23:16:28.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:28 smithi191 ceph-mon[24760]: osdmap e93: 8 total, 8 up, 8 in 2024-09-20T23:16:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:28 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]: dispatch 2024-09-20T23:16:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:28] "GET /metrics HTTP/1.1" 200 214934 "" "Prometheus/2.33.4" 2024-09-20T23:16:29.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:29 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]': finished 2024-09-20T23:16:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:29 smithi191 ceph-mon[24760]: osdmap e94: 8 total, 8 up, 8 in 2024-09-20T23:16:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:29 smithi191 ceph-mon[24760]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]': finished 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[23733]: osdmap e94: 8 total, 8 up, 8 in 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[23733]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4054424779' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3118221257"}]': finished 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[28691]: osdmap e94: 8 total, 8 up, 8 in 2024-09-20T23:16:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:29 smithi170 ceph-mon[28691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:30.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:31.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:31 smithi191 ceph-mon[24760]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-09-20T23:16:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:31 smithi170 ceph-mon[23733]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-09-20T23:16:31.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:31 smithi170 ceph-mon[28691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-09-20T23:16:32.797 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:32 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:32.798 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:32 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:32 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:34.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:34 smithi170 ceph-mon[23733]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:34.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:34 smithi170 ceph-mon[28691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:34 smithi191 ceph-mon[24760]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:34.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:35.864 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[23733]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:35.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:35.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:35.865 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[28691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:35.865 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:35.865 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:35 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:35.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:35 smithi191 ceph-mon[24760]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:35.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:35 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:35.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:35 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:36.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-20T23:16:36.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-20T23:16:36.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:16:36.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-09-20T23:16:36.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-20T23:16:36.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:16:36.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:16:37.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 568 B/s rd, 0 op/s 2024-09-20T23:16:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-20T23:16:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-20T23:16:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-20T23:16:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-20T23:16:37.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:37 smithi191 ceph-mon[24760]: osdmap e95: 8 total, 8 up, 8 in 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 568 B/s rd, 0 op/s 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-20T23:16:37.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[23733]: osdmap e95: 8 total, 8 up, 8 in 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 568 B/s rd, 0 op/s 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-20T23:16:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:37 smithi170 ceph-mon[28691]: osdmap e95: 8 total, 8 up, 8 in 2024-09-20T23:16:38.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:38 smithi191 ceph-mon[24760]: osdmap e96: 8 total, 8 up, 8 in 2024-09-20T23:16:38.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:38 smithi170 ceph-mon[23733]: osdmap e96: 8 total, 8 up, 8 in 2024-09-20T23:16:38.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:38] "GET /metrics HTTP/1.1" 200 214951 "" "Prometheus/2.33.4" 2024-09-20T23:16:38.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:38 smithi170 ceph-mon[28691]: osdmap e96: 8 total, 8 up, 8 in 2024-09-20T23:16:40.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:40 smithi191 ceph-mon[24760]: pgmap v130: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:40 smithi170 ceph-mon[23733]: pgmap v130: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:40 smithi170 ceph-mon[28691]: pgmap v130: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:40.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:42.377 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:42 smithi191 ceph-mon[24760]: pgmap v131: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:16:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:42 smithi170 ceph-mon[23733]: pgmap v131: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:16:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:42 smithi170 ceph-mon[28691]: pgmap v131: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:16:43.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:43 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:43 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:43 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:44.271 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:44 smithi191 ceph-mon[24760]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:44 smithi170 ceph-mon[23733]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:44.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:16:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:44 smithi170 ceph-mon[28691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:45.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:45.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:46.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:46 smithi170 ceph-mon[23733]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:46.544 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:46 smithi170 ceph-mon[28691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:46.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:46 smithi191 ceph-mon[24760]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:48.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:48 smithi191 ceph-mon[24760]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:16:48.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:48 smithi170 ceph-mon[23733]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:16:48.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:48 smithi170 ceph-mon[28691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:16:49.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:48] "GET /metrics HTTP/1.1" 200 214951 "" "Prometheus/2.33.4" 2024-09-20T23:16:50.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:50 smithi191 ceph-mon[24760]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-09-20T23:16:50.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:50 smithi170 ceph-mon[23733]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-09-20T23:16:50.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:50 smithi170 ceph-mon[28691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-09-20T23:16:50.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:16:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:16:52.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:52 smithi170 ceph-mon[23733]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:52.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:52 smithi170 ceph-mon[28691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:52.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:52 smithi191 ceph-mon[24760]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:53 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:53 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:53 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:16:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:54 smithi170 ceph-mon[23733]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:54 smithi170 ceph-mon[28691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:54.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:54 smithi191 ceph-mon[24760]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:16:55.161 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:16:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:16:55.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:55 smithi191 ceph-mon[24760]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:55.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[23733]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[28691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:56.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:16:58.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:16:57 smithi191 ceph-mon[24760]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:16:57 smithi170 ceph-mon[23733]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:16:57 smithi170 ceph-mon[28691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:16:59.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:16:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:16:58] "GET /metrics HTTP/1.1" 200 214897 "" "Prometheus/2.33.4" 2024-09-20T23:17:00.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:00 smithi191 ceph-mon[24760]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:00 smithi170 ceph-mon[23733]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:00 smithi170 ceph-mon[28691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:00.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:02.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:02 smithi191 ceph-mon[24760]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:02 smithi170 ceph-mon[23733]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:02 smithi170 ceph-mon[28691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:03.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:03 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:03 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:03 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:04.370 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:04 smithi170 ceph-mon[23733]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:04.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:04 smithi170 ceph-mon[28691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:04.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:04 smithi191 ceph-mon[24760]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:04.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:17:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:05.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:06.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:06 smithi191 ceph-mon[24760]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:06 smithi170 ceph-mon[23733]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:06.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:06 smithi170 ceph-mon[28691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:08.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:08 smithi191 ceph-mon[24760]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:08.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:08 smithi170 ceph-mon[23733]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:08.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:08 smithi170 ceph-mon[28691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:09.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:08] "GET /metrics HTTP/1.1" 200 214880 "" "Prometheus/2.33.4" 2024-09-20T23:17:10.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:10 smithi191 ceph-mon[24760]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:10.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:10 smithi170 ceph-mon[23733]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:10.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:10 smithi170 ceph-mon[28691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:10.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:12.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:12 smithi191 ceph-mon[24760]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:12 smithi170 ceph-mon[23733]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:12.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:12 smithi170 ceph-mon[28691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:13 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:13.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:13 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:13.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:13 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:14.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:14 smithi170 ceph-mon[23733]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:14.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:14 smithi170 ceph-mon[28691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:14 smithi191 ceph-mon[24760]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:14.984 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:17:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[23733]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[28691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:16.193 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:15 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:16.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:15 smithi191 ceph-mon[24760]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:15 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:18.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:17 smithi191 ceph-mon[24760]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:18.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:17 smithi170 ceph-mon[23733]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:18.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:17 smithi170 ceph-mon[28691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:19.081 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:18] "GET /metrics HTTP/1.1" 200 214880 "" "Prometheus/2.33.4" 2024-09-20T23:17:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:19 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:19 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:20.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:20 smithi191 ceph-mon[24760]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:20.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:20 smithi170 ceph-mon[23733]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:20 smithi170 ceph-mon[28691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:20.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:22.337 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:22 smithi191 ceph-mon[24760]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:22.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:22 smithi170 ceph-mon[28691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:22 smithi170 ceph-mon[23733]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:23.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:23 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:23.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:23 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:23.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:23 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:24.355 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:24 smithi191 ceph-mon[24760]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:24.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:24 smithi170 ceph-mon[23733]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:24.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:24 smithi170 ceph-mon[28691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:24.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:17:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:25.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:25 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:25 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:25 smithi191 ceph-mon[24760]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[23733]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:25.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:25 smithi170 ceph-mon[28691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:27.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:27 smithi191 ceph-mon[24760]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:27 smithi170 ceph-mon[23733]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:27 smithi170 ceph-mon[28691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:28] "GET /metrics HTTP/1.1" 200 214862 "" "Prometheus/2.33.4" 2024-09-20T23:17:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:30 smithi191 ceph-mon[24760]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:30 smithi170 ceph-mon[23733]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:30 smithi170 ceph-mon[28691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:30.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:32.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:32 smithi170 ceph-mon[23733]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:32.340 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:32 smithi170 ceph-mon[28691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:32 smithi191 ceph-mon[24760]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:33 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:33 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:33 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:34.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:34 smithi191 ceph-mon[24760]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:34 smithi170 ceph-mon[23733]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:34 smithi170 ceph-mon[28691]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:35.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:17:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[28691]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[23733]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:35 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:36.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:35 smithi191 ceph-mon[24760]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:36.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:35 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:35 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:37.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:17:37.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:17:37.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:17:37.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:17:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:17:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:17:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:37 smithi191 ceph-mon[24760]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:37 smithi170 ceph-mon[28691]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:37 smithi170 ceph-mon[23733]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:39.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:38] "GET /metrics HTTP/1.1" 200 214868 "" "Prometheus/2.33.4" 2024-09-20T23:17:40.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:40 smithi170 ceph-mon[23733]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:40.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:40 smithi170 ceph-mon[28691]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:40.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:40 smithi191 ceph-mon[24760]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:40.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:42.350 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:42 smithi170 ceph-mon[23733]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:42.350 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:42 smithi170 ceph-mon[28691]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:42.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:42 smithi191 ceph-mon[24760]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:43.345 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:43 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:43 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:43 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:44.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:44 smithi191 ceph-mon[24760]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:44 smithi170 ceph-mon[23733]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:44 smithi170 ceph-mon[28691]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:44.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:17:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:45.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:45 smithi191 ceph-mon[24760]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:45.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[23733]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:45.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:45.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:45.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[28691]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:45.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:45.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:47.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:47 smithi191 ceph-mon[24760]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:47 smithi170 ceph-mon[23733]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:47 smithi170 ceph-mon[28691]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:49.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:48] "GET /metrics HTTP/1.1" 200 214868 "" "Prometheus/2.33.4" 2024-09-20T23:17:50.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:50 smithi191 ceph-mon[24760]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:50 smithi170 ceph-mon[23733]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:50 smithi170 ceph-mon[28691]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:50.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:17:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:17:52.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:52 smithi170 ceph-mon[23733]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:52.360 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:52 smithi170 ceph-mon[28691]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:52.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:52 smithi191 ceph-mon[24760]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:53.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:53 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:53 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:53 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:17:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:54 smithi191 ceph-mon[24760]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:54 smithi170 ceph-mon[23733]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:54 smithi170 ceph-mon[28691]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:17:55.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:17:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:17:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[23733]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:56.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[28691]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:56.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:56 smithi191 ceph-mon[24760]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:17:58.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:17:58 smithi191 ceph-mon[24760]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:17:58 smithi170 ceph-mon[23733]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:58.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:17:58 smithi170 ceph-mon[28691]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:17:59.052 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:17:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:17:58] "GET /metrics HTTP/1.1" 200 214885 "" "Prometheus/2.33.4" 2024-09-20T23:18:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:00 smithi191 ceph-mon[24760]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:00 smithi170 ceph-mon[23733]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:00 smithi170 ceph-mon[28691]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:00.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:02.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:02 smithi170 ceph-mon[23733]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:02.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:02 smithi170 ceph-mon[28691]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:02.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:02 smithi191 ceph-mon[24760]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:03.356 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:03 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:03 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:03 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:04.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:04 smithi191 ceph-mon[24760]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:04 smithi170 ceph-mon[23733]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:04.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:04 smithi170 ceph-mon[28691]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:04.985 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:18:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:05.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-20T23:18:05.953 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:05 smithi191 ceph-mon[24760]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:05.953 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:05.954 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:05.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[28691]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:05.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:05.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:05.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[23733]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:05.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:05.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:07.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:07 smithi170 ceph-mon[23733]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:07.865 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:07 smithi170 ceph-mon[28691]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:07.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:07 smithi191 ceph-mon[24760]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:08.172 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-20T23:18:09.117 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:08] "GET /metrics HTTP/1.1" 200 214876 "" "Prometheus/2.33.4" 2024-09-20T23:18:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:10 smithi170 ceph-mon[23733]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:10.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:10 smithi170 ceph-mon[28691]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:10 smithi191 ceph-mon[24760]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:10.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-20T23:18:10.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:12.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:12 smithi170 ceph-mon[23733]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:12.308 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:12 smithi170 ceph-mon[28691]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:12.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:12 smithi191 ceph-mon[24760]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:13.319 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:13 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:13 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:13.340 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-20T23:18:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:13 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:14.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:14 smithi170 ceph-mon[23733]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:14.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:14 smithi170 ceph-mon[28691]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:14 smithi191 ceph-mon[24760]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:15.257 INFO:teuthology.orchestra.run.smithi170.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:15.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:15 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:18:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:15.877 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T23:18:15.887 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:18:15.887 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[23733]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:16 smithi170 ceph-mon[28691]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:16.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:16 smithi191 ceph-mon[24760]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:18:18.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:18 smithi191 ceph-mon[24760]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:18 smithi170 ceph-mon[23733]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:18.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:18 smithi170 ceph-mon[28691]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:18.897 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:18] "GET /metrics HTTP/1.1" 200 214876 "" "Prometheus/2.33.4" 2024-09-20T23:18:20.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:20 smithi170 ceph-mon[23733]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:20.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:20 smithi170 ceph-mon[28691]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:20.380 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:18:20.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:20 smithi191 ceph-mon[24760]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:20.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:21.032 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 5s ago 9m - - 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 16s ago 8m - - 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (3m) 5s ago 3m 24.0M - ba2b418f427c 48a1379e4494 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (3m) 16s ago 3m 57.7M - 8.3.5 dad864ee21e9 7e83a8882e65 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (2m) 5s ago 2m 52.7M - 3.5 e1d6a67b021e 805a6a106ba3 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443 running (8m) 16s ago 8m 411M - 17.2.0 e1d6a67b021e 677c40cb8bc1 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:9283 running (9m) 5s ago 9m 463M - 17.2.0 e1d6a67b021e d95903a05d4f 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (9m) 5s ago 10m 52.0M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (8m) 16s ago 8m 41.3M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (8m) 5s ago 8m 43.5M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (4m) 5s ago 4m 18.4M - 1dbe0e931976 45dee285dee8 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (4m) 16s ago 4m 15.8M - 1dbe0e931976 88634964767c 2024-09-20T23:18:21.033 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 5s ago 7m 51.6M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (7m) 5s ago 7m 53.0M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 5s ago 7m 46.2M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (6m) 5s ago 6m 49.2M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (6m) 16s ago 6m 49.7M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (5m) 16s ago 5m 51.0M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (5m) 16s ago 5m 47.7M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (5m) 16s ago 5m 48.7M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (3m) 16s ago 4m 65.0M - 514e6a882f6e df5fa7cfeb94 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (2m) 5s ago 2m 68.6M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (2m) 16s ago 2m 71.2M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (2m) 5s ago 2m 69.0M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:18:21.034 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (2m) 16s ago 2m 68.7M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:18:21.426 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:18:21.426 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:18:21.426 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-20T23:18:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:18:21.428 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:18:21.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:21 smithi170 ceph-mon[23733]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:21.428 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:21 smithi170 ceph-mon[28691]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:21.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:21 smithi191 ceph-mon[24760]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 image" 2024-09-20T23:18:21.767 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:18:22.154 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:18:22.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:22 smithi191 ceph-mon[24760]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:22.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:22 smithi191 ceph-mon[24760]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:22 smithi191 ceph-mon[24760]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2669830479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:22.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/205431277' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[23733]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[23733]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[23733]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2669830479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/205431277' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[28691]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:22.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[28691]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[28691]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2669830479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:22.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/205431277' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:23.470 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:23 smithi191 ceph-mon[24760]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:23.470 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:23 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:23.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:23 smithi170 ceph-mon[23733]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:23.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:23 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:23.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:23 smithi170 ceph-mon[28691]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:23.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:23 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:24.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:24 smithi191 ceph-mon[24760]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:24 smithi170 ceph-mon[23733]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:24 smithi170 ceph-mon[28691]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:25.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:18:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:25.910 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:25 smithi191 ceph-mon[24760]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:25.910 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:25 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:25.910 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:25 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[23733]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[28691]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:25 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:28.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:27 smithi191 ceph-mon[24760]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:28.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:27 smithi170 ceph-mon[23733]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:28.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:27 smithi170 ceph-mon[28691]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:28] "GET /metrics HTTP/1.1" 200 214850 "" "Prometheus/2.33.4" 2024-09-20T23:18:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:30 smithi191 ceph-mon[24760]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:30 smithi170 ceph-mon[23733]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:30 smithi170 ceph-mon[28691]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:30.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:32.390 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:32 smithi170 ceph-mon[23733]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:32.390 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:32 smithi170 ceph-mon[28691]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:32 smithi191 ceph-mon[24760]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:33 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:33 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:33 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:34 smithi191 ceph-mon[24760]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:34 smithi170 ceph-mon[23733]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:34 smithi170 ceph-mon[28691]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:35.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:18:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:36.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:36 smithi191 ceph-mon[24760]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:36.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:36 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[23733]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[28691]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:36.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:36 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:37.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:18:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:37 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:18:37.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:18:37.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:37 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:18:37.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:18:37.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:37 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:18:38.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:38 smithi170 ceph-mon[28691]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:38.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:38 smithi170 ceph-mon[23733]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:38.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:38 smithi191 ceph-mon[24760]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:38.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:38] "GET /metrics HTTP/1.1" 200 214845 "" "Prometheus/2.33.4" 2024-09-20T23:18:40.657 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:40 smithi191 ceph-mon[24760]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:40.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:40 smithi170 ceph-mon[23733]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:40.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:40 smithi170 ceph-mon[28691]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:40.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:42.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:42 smithi191 ceph-mon[24760]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:42.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:42 smithi170 ceph-mon[23733]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:42.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:42 smithi170 ceph-mon[28691]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:43.621 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:43 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:43 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:43.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:43 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:44.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:44 smithi191 ceph-mon[24760]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:44.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:44 smithi170 ceph-mon[23733]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:44 smithi170 ceph-mon[28691]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:45.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:18:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:46.165 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:45 smithi191 ceph-mon[24760]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:46.165 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:46.166 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:45 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[23733]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[28691]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:46.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:45 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:48.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:47 smithi191 ceph-mon[24760]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:48.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:47 smithi170 ceph-mon[23733]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:48.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:47 smithi170 ceph-mon[28691]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:49.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:48] "GET /metrics HTTP/1.1" 200 214845 "" "Prometheus/2.33.4" 2024-09-20T23:18:50.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:50 smithi170 ceph-mon[23733]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:50.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:50 smithi170 ceph-mon[28691]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:50.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:50 smithi191 ceph-mon[24760]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:50.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:18:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:18:52.411 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:52 smithi170 ceph-mon[23733]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:52.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:52 smithi170 ceph-mon[28691]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:52.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:52 smithi191 ceph-mon[24760]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:52.602 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 18s ago 9m - - 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 8s ago 9m - - 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (3m) 18s ago 4m 24.0M - ba2b418f427c 48a1379e4494 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (4m) 8s ago 4m 56.8M - 8.3.5 dad864ee21e9 7e83a8882e65 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (2m) 18s ago 2m 54.9M - 3.5 e1d6a67b021e 805a6a106ba3 2024-09-20T23:18:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443 running (8m) 8s ago 8m 411M - 17.2.0 e1d6a67b021e 677c40cb8bc1 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:9283 running (10m) 18s ago 10m 463M - 17.2.0 e1d6a67b021e d95903a05d4f 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (10m) 18s ago 10m 52.5M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (9m) 8s ago 9m 38.8M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (9m) 18s ago 9m 43.7M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (4m) 18s ago 4m 16.1M - 1dbe0e931976 45dee285dee8 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (4m) 8s ago 4m 15.5M - 1dbe0e931976 88634964767c 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 18s ago 8m 51.7M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 18s ago 8m 53.2M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 18s ago 7m 46.3M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (7m) 18s ago 7m 49.4M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (6m) 8s ago 6m 50.1M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (6m) 8s ago 6m 51.4M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (6m) 8s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (5m) 8s ago 5m 49.0M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (3m) 8s ago 5m 65.0M - 514e6a882f6e df5fa7cfeb94 2024-09-20T23:18:53.297 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (3m) 18s ago 3m 68.7M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:18:53.298 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (3m) 8s ago 3m 71.3M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:18:53.298 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (2m) 18s ago 2m 69.1M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:18:53.298 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (2m) 8s ago 2m 68.9M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:18:53.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:53 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:53 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:53 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-20T23:18:53.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:18:53.666 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:18:53.985 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:18:53.985 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:18:53.985 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:18:53.985 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:18:53.985 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:18:53.986 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 image" 2024-09-20T23:18:53.986 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:18:54.211 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[23733]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:54.211 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[23733]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[23733]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[23733]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/944715182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[28691]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[28691]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[28691]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[28691]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.212 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:54 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/944715182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:54.345 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:18:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:54 smithi191 ceph-mon[24760]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:18:54.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:54 smithi191 ceph-mon[24760]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:54 smithi191 ceph-mon[24760]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:54 smithi191 ceph-mon[24760]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:54 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/944715182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:18:55.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[23733]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:55.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1603981285' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:55.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[28691]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:55.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1603981285' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:55.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:55 smithi191 ceph-mon[24760]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:55.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:55 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1603981285' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:18:55.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:55 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:55.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:18:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:18:56.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:56.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (unknown) 2024-09-20T23:18:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-20T23:18:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:18:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 on smithi191 2024-09-20T23:18:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:56 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (unknown) 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 on smithi191 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: Upgrade: Target is version 19.1.1-367-g9e2ac70b (unknown) 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, digests ['quay.ceph.io/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5'] 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 on smithi191 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:56 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:18:58.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:18:58 smithi191 ceph-mon[24760]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:58.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:18:58 smithi170 ceph-mon[23733]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:58.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:18:58 smithi170 ceph-mon[28691]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:18:59.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:18:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:18:58] "GET /metrics HTTP/1.1" 200 214807 "" "Prometheus/2.33.4" 2024-09-20T23:19:00.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:00 smithi191 ceph-mon[24760]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:00 smithi170 ceph-mon[23733]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:00 smithi170 ceph-mon[28691]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:00.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:02.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:02 smithi191 ceph-mon[24760]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:02 smithi170 ceph-mon[23733]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:02 smithi170 ceph-mon[28691]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:03 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:03.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:03 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:03.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:03 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:03.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:03.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:03.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:03.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:04.628 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:04 smithi191 ceph-mon[24760]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:04 smithi170 ceph-mon[23733]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:04 smithi170 ceph-mon[28691]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:05.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:19:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:19:06.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:05 smithi191 ceph-mon[24760]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:05 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[23733]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[28691]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:06.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:05 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:08.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:07 smithi191 ceph-mon[24760]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:07 smithi170 ceph-mon[23733]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:07 smithi170 ceph-mon[28691]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:09.240 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:08] "GET /metrics HTTP/1.1" 200 214811 "" "Prometheus/2.33.4" 2024-09-20T23:19:10.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:10 smithi191 ceph-mon[24760]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:10 smithi170 ceph-mon[23733]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:10 smithi170 ceph-mon[28691]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:10.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:12.420 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:12 smithi170 ceph-mon[23733]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:12.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:12 smithi170 ceph-mon[28691]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:12.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:12 smithi191 ceph-mon[24760]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:13 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:13.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:13 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:13.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:13 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:13.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=error ts=2024-09-20T23:19:13.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:13.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:13.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:13.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:13.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:14 smithi191 ceph-mon[24760]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:14 smithi170 ceph-mon[23733]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:14 smithi170 ceph-mon[28691]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:15.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:15 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.170 - - [20/Sep/2024:23:19:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:19:16.279 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:16 smithi191 ceph-mon[24760]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:16.280 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:16.280 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:16 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[23733]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[28691]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:16 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:18.195 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:18 smithi170 ceph-mon[23733]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:18.195 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:18 smithi170 ceph-mon[28691]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:18.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:18 smithi191 ceph-mon[24760]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:19.023 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:18] "GET /metrics HTTP/1.1" 200 214811 "" "Prometheus/2.33.4" 2024-09-20T23:19:20.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:20 smithi170 ceph-mon[23733]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:20.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:20 smithi170 ceph-mon[28691]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:20.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:20 smithi191 ceph-mon[24760]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:20.961 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[26238]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:22.380 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:22 smithi191 ceph-mon[24760]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:22.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:22 smithi170 ceph-mon[23733]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:22.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:22 smithi170 ceph-mon[28691]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.x 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: Deploying daemon mgr.x on smithi191 2024-09-20T23:19:23.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:23 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.x 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: Deploying daemon mgr.x on smithi191 2024-09-20T23:19:23.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.x 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: Deploying daemon mgr.x on smithi191 2024-09-20T23:19:23.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:23.744 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=error ts=2024-09-20T23:19:23.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:23.744 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:23.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:23.744 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:23.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:24.100 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:23 smithi191 systemd[1]: Stopping Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:24.100 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:23 smithi191 bash[50550]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr.x" found: no such container 2024-09-20T23:19:24.396 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 podman[50562]: 2024-09-20 23:19:24.097777591 +0000 UTC m=+0.125602577 container died 677c40cb8bc11d086e4720a2eb2e7f501f5b70ced021d5522af7d2b2eff1c815 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, GIT_CLEAN=True, io.buildah.version=1.19.8, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, RELEASE=HEAD, architecture=x86_64, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., vcs-type=git, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-20T23:19:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:24 smithi170 ceph-mon[23733]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:24.680 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:24.249Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=2 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": dial tcp 172.21.15.191:8443: connect: connection refused" 2024-09-20T23:19:24.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:24 smithi170 ceph-mon[28691]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:24.680 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:19:24.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:24 smithi191 ceph-mon[24760]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:24.723 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 podman[50562]: 2024-09-20 23:19:24.50282833 +0000 UTC m=+0.530653312 container cleanup 677c40cb8bc11d086e4720a2eb2e7f501f5b70ced021d5522af7d2b2eff1c815 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, io.openshift.tags=base centos centos-stream, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, GIT_CLEAN=True, release=754, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, io.openshift.expose-services=, vendor=Red Hat, Inc., distribution-scope=public, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870) 2024-09-20T23:19:24.723 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 bash[50562]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x 2024-09-20T23:19:24.723 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 bash[50589]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr.x" found: no such container 2024-09-20T23:19:24.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 podman[50574]: 2024-09-20 23:19:24.721915947 +0000 UTC m=+0.619731380 container remove 677c40cb8bc11d086e4720a2eb2e7f501f5b70ced021d5522af7d2b2eff1c815 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., RELEASE=HEAD, distribution-scope=public, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, io.openshift.expose-services=, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, vcs-type=git, io.k8s.display-name=CentOS Stream 8, ceph=True, CEPH_POINT_RELEASE=-17.2.0) 2024-09-20T23:19:24.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:19:24.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Failed with result 'exit-code'. 2024-09-20T23:19:24.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 systemd[1]: Stopped Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:24.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Consumed 17.266s CPU time. 2024-09-20T23:19:24.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:24 smithi191 systemd[1]: Starting Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 9s ago 10m - - 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 0s ago 9m - - 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (4m) 9s ago 4m 26.2M - ba2b418f427c 48a1379e4494 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (4m) 0s ago 4m 57.3M - 8.3.5 dad864ee21e9 7e83a8882e65 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (3m) 9s ago 3m 55.2M - 3.5 e1d6a67b021e 805a6a106ba3 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443 running (9m) 0s ago 9m 412M - 17.2.0 e1d6a67b021e 677c40cb8bc1 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:9283 running (11m) 9s ago 11m 465M - 17.2.0 e1d6a67b021e d95903a05d4f 2024-09-20T23:19:25.272 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (11m) 9s ago 11m 53.0M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (9m) 0s ago 9m 39.9M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (9m) 9s ago 9m 43.9M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (5m) 9s ago 5m 16.2M - 1dbe0e931976 45dee285dee8 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (5m) 0s ago 5m 16.0M - 1dbe0e931976 88634964767c 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 9s ago 9m 52.1M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 9s ago 8m 53.6M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (8m) 9s ago 8m 46.6M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (7m) 9s ago 7m 49.8M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (7m) 0s ago 7m 50.5M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (7m) 0s ago 7m 51.7M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (6m) 0s ago 6m 48.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (6m) 0s ago 6m 49.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (4m) 0s ago 5m 65.2M - 514e6a882f6e df5fa7cfeb94 2024-09-20T23:19:25.273 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (3m) 9s ago 3m 69.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:19:25.274 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (3m) 0s ago 3m 71.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:19:25.274 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (3m) 9s ago 3m 69.4M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:19:25.274 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (3m) 0s ago 3m 69.1M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:19:25.319 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 podman[50699]: 2024-09-20 23:19:25.042936987 +0000 UTC m=+0.016811180 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:19:25.319 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 podman[50699]: 2024-09-20 23:19:25.191597328 +0000 UTC m=+0.165471509 container create d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-20T23:19:25.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 172.21.15.191 - - [20/Sep/2024:23:19:25] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 podman[50699]: 2024-09-20 23:19:25.403967107 +0000 UTC m=+0.377841302 container init d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70) 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 podman[50699]: 2024-09-20 23:19:25.406892776 +0000 UTC m=+0.380766958 container start d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-mgr[50730]: -- 172.21.15.191:0/1002473416 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f2fdf30e0 con 0x561f2fdd0800 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 bash[50699]: d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 systemd[1]: Started Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:25.578 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:25.528+0000 7f2a6c7b6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:19:25.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:19:25.650 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons" 2024-09-20T23:19:25.969 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:19:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:25.591+0000 7f2a6c7b6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:19:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:25.750+0000 7f2a6c7b6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:19:25.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:25.823+0000 7f2a6c7b6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='client.25072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/151120129' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[28691]: osdmap e97: 8 total, 8 up, 8 in 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='client.25072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/151120129' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:19:26.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mon[23733]: osdmap e97: 8 total, 8 up, 8 in 2024-09-20T23:19:26.321 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:19:26.436 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:25.977+0000 7f2a6c7b6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:19:26.436 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:26.123+0000 7f2a6c7b6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:19:26.436 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:26.434+0000 7f2a6c7b6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='client.25072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/151120129' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' 2024-09-20T23:19:26.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:26.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:19:26.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-mon[24760]: osdmap e97: 8 total, 8 up, 8 in 2024-09-20T23:19:26.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:26.496+0000 7f2a6c7b6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:19:26.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:26.678+0000 7f2a6c7b6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:19:27.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: Failing over to other MGR 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3505752465' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:19:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-mon[24760]: mgrmap e21: x(active, starting, since 1.00298s), standbys: y 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: Failing over to other MGR 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3505752465' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:19:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[23733]: mgrmap e21: x(active, starting, since 1.00298s), standbys: y 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:26.845+0000 7fb99e0c7700 -1 mgr handle_mgr_map I was active but no longer amignoring --setuser ceph since I am not root 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ignoring --setgroup ceph since I am not root 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:26 smithi170 ceph-mgr[23966]: -- 172.21.15.170:0/3338119932 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bf4526c340 con 0x55bf45244800 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.015+0000 7f5394d62000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.096+0000 7f5394d62000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: Failing over to other MGR 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3505752465' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:19:27.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:19:27.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: from='mgr.24358 172.21.15.170:0/4205453431' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:19:27.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-mon[28691]: mgrmap e21: x(active, starting, since 1.00298s), standbys: y 2024-09-20T23:19:27.712 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:27.438Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=5 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": dial tcp 172.21.15.170:8443: connect: connection refused" 2024-09-20T23:19:27.712 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.273+0000 7f5394d62000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:19:27.712 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.363+0000 7f5394d62000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:19:27.712 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.494+0000 7f5394d62000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:19:27.712 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:27.710+0000 7f5394d62000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:19:27.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:27.583+0000 7f2a6c7b6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:19:27.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:27.649+0000 7f2a6c7b6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:19:28.308 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:28.049+0000 7f5394d62000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:19:28.308 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:28.140+0000 7f5394d62000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:19:28.560 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.380+0000 7f2a6c7b6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:19:28.560 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.499+0000 7f2a6c7b6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:19:28.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:28.305+0000 7f5394d62000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:19:28.869 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.655+0000 7f2a6c7b6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:19:28.869 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.717+0000 7f2a6c7b6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:19:28.869 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.867+0000 7f2a6c7b6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:19:29.162 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.937+0000 7f2a6c7b6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:19:29.163 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:28.998+0000 7f2a6c7b6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:19:29.163 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.161+0000 7f2a6c7b6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:19:29.459 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.227+0000 7f2a6c7b6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:19:29.459 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.295+0000 7f2a6c7b6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:19:29.459 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.378+0000 7f2a6c7b6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:19:29.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.457+0000 7f2a6c7b6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:19:29.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:29.516+0000 7f2a6c7b6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:19:29.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:29.361+0000 7f5394d62000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:19:29.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:29.453+0000 7f5394d62000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: Active manager daemon x restarted 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: Activating manager daemon x 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: osdmap e98: 8 total, 8 up, 8 in 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:30.631 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:30.349+0000 7f2a6c7b6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STARTING 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: CherryPy Checker: 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: The Application mounted at '' has an empty config. 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Serving on http://:::9283 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STARTED 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STOPPING 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:19:30.632 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STOPPED 2024-09-20T23:19:30.685 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:30.361+0000 7f5394d62000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: Active manager daemon x restarted 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: Activating manager daemon x 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: osdmap e98: 8 total, 8 up, 8 in 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: Active manager daemon x restarted 2024-09-20T23:19:30.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: Activating manager daemon x 2024-09-20T23:19:30.687 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: osdmap e98: 8 total, 8 up, 8 in 2024-09-20T23:19:30.687 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:19:30.687 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:30.687 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:19:30.687 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:30.903 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STARTING 2024-09-20T23:19:30.904 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:30] "GET /metrics HTTP/1.1" 200 35359 "" "Prometheus/2.33.4" 2024-09-20T23:19:30.904 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Serving on http://:::9283 2024-09-20T23:19:30.904 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:19:30] ENGINE Bus STARTED 2024-09-20T23:19:30.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:30.683+0000 7f5394d62000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:19:30.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:30.824+0000 7f5394d62000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:19:30.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:30.919+0000 7f5394d62000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:19:31.282 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.024+0000 7f5394d62000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:19:31.282 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.120+0000 7f5394d62000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:19:31.282 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.279+0000 7f5394d62000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: mgrmap e22: x(active, starting, since 0.059791s), standbys: y 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:19:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: Manager daemon x is now available 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:31 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:31.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:31.324Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=6 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:31.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.395+0000 7f5394d62000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:19:31.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.517+0000 7f5394d62000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: mgrmap e22: x(active, starting, since 0.059791s), standbys: y 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:19:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: Manager daemon x is now available 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: mgrmap e22: x(active, starting, since 0.059791s), standbys: y 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:19:31.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: Manager daemon x is now available 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:31.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:19:32.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.839+0000 7f5394d62000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:19:32.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:31.946+0000 7f5394d62000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:19:32.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:32.051+0000 7f5394d62000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Queued rgw.foo for migration 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Queued rgw.smpl for migration 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Checking for cert/key for grafana.a 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:19:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: mgrmap e23: x(active, since 1.07738s), standbys: y 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:32.552+0000 7f29c8f70640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:23:19:32] ENGINE Error in HTTPServer.serve 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Traceback (most recent call last): 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: self._connections.run(self.expiration_interval) 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: self._run(expiration_interval) 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:19:32.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: s = self.context.wrap_socket( 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return self.sslsocket_class._create( 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: self.do_handshake() 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: self._sslobj.do_handshake() 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:19:32.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Queued rgw.foo for migration 2024-09-20T23:19:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Queued rgw.smpl for migration 2024-09-20T23:19:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-20T23:19:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-20T23:19:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Checking for cert/key for grafana.a 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: mgrmap e23: x(active, since 1.07738s), standbys: y 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Queued rgw.foo for migration 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Queued rgw.smpl for migration 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-20T23:19:32.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Checking for cert/key for grafana.a 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: mgrmap e23: x(active, since 1.07738s), standbys: y 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:32.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:32 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:19:33.433 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:33.151+0000 7f5394d62000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:19:33.433 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:19:33] ENGINE Bus STARTING 2024-09-20T23:19:33.433 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: CherryPy Checker: 2024-09-20T23:19:33.433 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: The Application mounted at '' has an empty config. 2024-09-20T23:19:33.434 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: 2024-09-20T23:19:33.434 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:19:33] ENGINE Serving on http://:::9283 2024-09-20T23:19:33.434 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: [20/Sep/2024:23:19:33] ENGINE Bus STARTED 2024-09-20T23:19:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:19:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:33.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=error ts=2024-09-20T23:19:33.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.170:8443//api/prometheus_receiver\": dial tcp 172.21.15.170:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:33.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:33.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:33.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:33.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:19:33.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:33.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:19:33.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:33.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-20T23:19:33.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:19:33.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:19:33.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:19:33.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:19:33.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:19:33.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/977717420' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: [20/Sep/2024:23:19:32] ENGINE Bus STARTING 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: [20/Sep/2024:23:19:32] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: [20/Sep/2024:23:19:32] ENGINE Error in HTTPServer.serve 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:19:34.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._run(expiration_interval) 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: s = self.context.wrap_socket( 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.sslsocket_class._create( 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.do_handshake() 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._sslobj.do_handshake() 2024-09-20T23:19:34.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: [20/Sep/2024:23:19:32] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: [20/Sep/2024:23:19:32] ENGINE Bus STARTED 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: Reconfiguring daemon agent.smithi170 on smithi170 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: Deploying cephadm binary to smithi170 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:34 smithi191 ceph-mon[24760]: mgrmap e25: x(active, since 3s), standbys: y 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: [20/Sep/2024:23:19:32] ENGINE Bus STARTING 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: [20/Sep/2024:23:19:32] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: [20/Sep/2024:23:19:32] ENGINE Error in HTTPServer.serve 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:19:34.743 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.do_handshake() 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:19:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: [20/Sep/2024:23:19:32] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: [20/Sep/2024:23:19:32] ENGINE Bus STARTED 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: Reconfiguring daemon agent.smithi170 on smithi170 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: Deploying cephadm binary to smithi170 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[28691]: mgrmap e25: x(active, since 3s), standbys: y 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: [20/Sep/2024:23:19:32] ENGINE Bus STARTING 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: [20/Sep/2024:23:19:32] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: [20/Sep/2024:23:19:32] ENGINE Error in HTTPServer.serve 2024-09-20T23:19:34.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:19:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.do_handshake() 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: [20/Sep/2024:23:19:32] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: [20/Sep/2024:23:19:32] ENGINE Bus STARTED 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: Reconfiguring daemon agent.smithi170 on smithi170 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: Deploying cephadm binary to smithi170 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:34 smithi170 ceph-mon[23733]: mgrmap e25: x(active, since 3s), standbys: y 2024-09-20T23:19:35.199 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:34 smithi170 systemd[1]: Stopping Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[23733]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-20T23:19:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[23733]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:19:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[23733]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[23733]: mgrmap e26: x(active, since 4s), standbys: y 2024-09-20T23:19:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[28691]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-20T23:19:35.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[28691]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:19:35.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[28691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:35.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:35 smithi170 ceph-mon[28691]: mgrmap e26: x(active, since 4s), standbys: y 2024-09-20T23:19:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:35 smithi191 ceph-mon[24760]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-20T23:19:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:35 smithi191 ceph-mon[24760]: Deploying daemon node-exporter.a on smithi170 2024-09-20T23:19:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:35 smithi191 ceph-mon[24760]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:35 smithi191 ceph-mon[24760]: mgrmap e26: x(active, since 4s), standbys: y 2024-09-20T23:19:36.487 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:36 smithi170 podman[62155]: 2024-09-20 23:19:36.241540228 +0000 UTC m=+0.111215002 container died 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:36.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:36 smithi170 ceph-mon[23733]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:36.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:36 smithi170 ceph-mon[28691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:36.743 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:36 smithi170 podman[62155]: 2024-09-20 23:19:36.681807948 +0000 UTC m=+0.551482763 container cleanup 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:36.743 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:36 smithi170 bash[62155]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a 2024-09-20T23:19:36.883 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:36 smithi191 ceph-mon[24760]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:19:37.226 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:36 smithi170 podman[62167]: 2024-09-20 23:19:36.933332945 +0000 UTC m=+0.691755621 container remove 45dee285dee899538341e70fbbde9bd25ad36e7357475a4d1c2cc83b9e82d5de (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:37.227 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:36 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:19:37.227 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-20T23:19:37.227 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 systemd[1]: Stopped Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:37.227 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Consumed 3.093s CPU time. 2024-09-20T23:19:37.493 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 systemd[1]: Starting Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:37.895 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 bash[62348]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-20T23:19:38.243 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 bash[62348]: Getting image source signatures 2024-09-20T23:19:38.243 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 bash[62348]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-20T23:19:38.243 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 bash[62348]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-20T23:19:38.243 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:37 smithi170 bash[62348]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-20T23:19:39.115 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:38] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:39 smithi170 ceph-mon[23733]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:19:39.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:39 smithi170 ceph-mon[28691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:19:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:39 smithi191 ceph-mon[24760]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:19:39.993 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:39 smithi170 bash[62348]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-20T23:19:40.450 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 bash[62348]: Writing manifest to image destination 2024-09-20T23:19:40.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-mon[23733]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:19:40.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-mon[28691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:19:40.710 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 podman[62348]: 2024-09-20 23:19:40.447869972 +0000 UTC m=+3.023106134 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-20T23:19:40.710 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 podman[62348]: 2024-09-20 23:19:40.563488816 +0000 UTC m=+3.138725012 container create 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:40.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:40 smithi191 ceph-mon[24760]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:19:40.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:40] "GET /metrics HTTP/1.1" 200 35359 "" "Prometheus/2.33.4" 2024-09-20T23:19:41.116 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 podman[62348]: 2024-09-20 23:19:40.815591158 +0000 UTC m=+3.390827323 container init 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:41.116 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 podman[62348]: 2024-09-20 23:19:40.818494069 +0000 UTC m=+3.393730223 container start 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:41.116 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.822Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.822Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.822Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=arp 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-20T23:19:41.117 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=edac 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-20T23:19:41.118 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=os 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-20T23:19:41.119 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=stat 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=time 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=uname 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-20T23:19:41.120 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.823Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-20T23:19:41.121 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.824Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-20T23:19:41.121 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a[62694]: ts=2024-09-20T23:19:40.824Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-20T23:19:41.121 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 bash[62348]: 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 2024-09-20T23:19:41.121 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:19:40 smithi170 systemd[1]: Started Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[23733]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[23733]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[28691]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:19:42.216 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:41 smithi170 ceph-mon[28691]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:19:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:41 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:41 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:41 smithi191 ceph-mon[24760]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-20T23:19:42.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:41 smithi191 ceph-mon[24760]: Deploying daemon alertmanager.a on smithi170 2024-09-20T23:19:42.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:19:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:19:42.315Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.191:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.170:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:19:43.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:42 smithi191 ceph-mon[24760]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:19:43.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:42 smithi170 ceph-mon[23733]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:19:43.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:42 smithi170 ceph-mon[28691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:19:43.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:43 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=error ts=2024-09-20T23:19:43.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:43.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:43 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:43.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.170:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.170 because it doesn't contain any IP SANs" 2024-09-20T23:19:43.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:43 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=warn ts=2024-09-20T23:19:43.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.191:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.191 because it doesn't contain any IP SANs" 2024-09-20T23:19:44.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:44 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:44 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:44 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:45.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:45 smithi191 ceph-mon[24760]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:45 smithi170 ceph-mon[23733]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:45 smithi170 ceph-mon[28691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:46.378 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:46 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:46 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:46 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:19:47.398 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:47 smithi191 ceph-mon[24760]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:47 smithi170 ceph-mon[23733]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:47 smithi170 ceph-mon[28691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:49.087 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:48] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:49 smithi191 ceph-mon[24760]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:49.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:49 smithi170 ceph-mon[28691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:49.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:49 smithi170 ceph-mon[23733]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:19:50.152 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:49 smithi170 systemd[1]: Stopping Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:50.477 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[49106]: level=info ts=2024-09-20T23:19:50.150Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:19:50.478 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 podman[63135]: 2024-09-20 23:19:50.171129918 +0000 UTC m=+0.144469315 container died 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:50.637 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:50 smithi191 ceph-mon[24760]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:50 smithi170 ceph-mon[23733]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:50.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:50 smithi170 ceph-mon[28691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:50.744 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 podman[63135]: 2024-09-20 23:19:50.583931878 +0000 UTC m=+0.557271275 container cleanup 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:50.744 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 bash[63135]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a 2024-09-20T23:19:50.915 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:50] "GET /metrics HTTP/1.1" 200 38165 "" "Prometheus/2.33.4" 2024-09-20T23:19:51.146 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 podman[63147]: 2024-09-20 23:19:50.785313643 +0000 UTC m=+0.613632976 container remove 48a1379e4494dfab4be9003b9f484b49d62c3cf235128e5e9508aa1e1b1827f8 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:51.146 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:50 smithi170 podman[63147]: 2024-09-20 23:19:50.885839539 +0000 UTC m=+0.714158803 volume remove 081782cb895ceb9654a31c688985654043300edca96553ac5bd435a5b6013e7e 2024-09-20T23:19:51.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-20T23:19:51.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 systemd[1]: Stopped Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:51.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service: Consumed 1.111s CPU time. 2024-09-20T23:19:51.493 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 systemd[1]: Starting Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:19:51.862 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 podman[63274]: 2024-09-20 23:19:51.473313771 +0000 UTC m=+0.015803743 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-09-20T23:19:51.862 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 podman[63274]: 2024-09-20 23:19:51.595858926 +0000 UTC m=+0.138348891 volume create ebad98684cd527f8bb31290446e2f205bb56213cbf501c9f033732f58c7d895d 2024-09-20T23:19:51.862 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 podman[63274]: 2024-09-20 23:19:51.688046288 +0000 UTC m=+0.230536290 container create 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:52.243 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 podman[63274]: 2024-09-20 23:19:51.948637582 +0000 UTC m=+0.491127541 container init 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 podman[63274]: 2024-09-20 23:19:51.951406101 +0000 UTC m=+0.493896071 container start 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.963Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.963Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.964Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.170 port=9094 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.965Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.989Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.989Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.992Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-20T23:19:52.244 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:51.992Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-20T23:19:52.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:19:52.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.191:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.170:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:19:52.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:52 smithi170 bash[63274]: 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee 2024-09-20T23:19:52.743 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:52 smithi170 systemd[1]: Started Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:52 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:19:52.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:52 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:54.113 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:19:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:19:53.966Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000967531s 2024-09-20T23:19:54.271 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:54 smithi191 ceph-mon[24760]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:54.271 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:54 smithi191 ceph-mon[24760]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:19:54.271 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:54 smithi191 ceph-mon[24760]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:19:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[23733]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[23733]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:19:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[23733]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:19:54.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[28691]: from='client.14958 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:19:54.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[28691]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:19:54.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:54 smithi170 ceph-mon[28691]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:19:55.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:55 smithi191 ceph-mon[24760]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:55 smithi170 ceph-mon[23733]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:55 smithi170 ceph-mon[28691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:56 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:56 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:56 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:56 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.692 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:19:56.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:19:56.251+0000 7f29fca94640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Creating ceph-iscsi config... 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Traceback (most recent call last): 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return _run_code(code, main_globals, None, 2024-09-20T23:19:56.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: exec(code, run_globals) 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:56.728 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Traceback (most recent call last): 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return self.wait_async( 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return future.result(timeout) 2024-09-20T23:19:56.729 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return self.__get_result() 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: raise self._exception 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: out, err, code = await self._run_cephadm( 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: raise OrchestratorError( 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Creating ceph-iscsi config... 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:56.730 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: Traceback (most recent call last): 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: return _run_code(code, main_globals, None, 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: exec(code, run_globals) 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:56.731 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:56.732 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:19:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.392 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 starting - - - - 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 32s ago 10m - - 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 starting - - - - 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (5m) 32s ago 5m 57.3M - 8.3.5 dad864ee21e9 7e83a8882e65 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (3m) 41s ago 3m 55.2M - 3.5 e1d6a67b021e 805a6a106ba3 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283 starting - - - - 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:9283 running (11m) 41s ago 11m 465M - 17.2.0 e1d6a67b021e d95903a05d4f 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (11m) 41s ago 11m 53.0M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (10m) 32s ago 10m 39.9M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (10m) 41s ago 10m 43.9M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 starting - - - - 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (5m) 32s ago 5m 16.0M - 1dbe0e931976 88634964767c 2024-09-20T23:19:57.393 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 41s ago 9m 52.1M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 41s ago 9m 53.6M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (8m) 41s ago 8m 46.6M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (8m) 41s ago 8m 49.8M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (7m) 32s ago 7m 50.5M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (7m) 32s ago 7m 51.7M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (7m) 32s ago 7m 48.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (6m) 32s ago 6m 49.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (4m) 32s ago 6m 65.2M - 514e6a882f6e df5fa7cfeb94 2024-09-20T23:19:57.394 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (4m) 41s ago 4m 69.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:19:57.395 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (4m) 32s ago 4m 71.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:19:57.395 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (3m) 41s ago 3m 69.4M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:19:57.395 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (3m) 32s ago 3m 69.1M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:19:57.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:57 smithi191 ceph-mon[24760]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: exec(code, run_globals) 2024-09-20T23:19:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:19:57.728 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.wait_async( 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: return future.result(timeout) 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.__get_result() 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: raise self._exception 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: raise OrchestratorError( 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.729 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: exec(code, run_globals) 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.730 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.731 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.731 INFO:journalctl@ceph.mon.b.smithi191.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.731 INFO:journalctl@ceph.mon.b.smithi191.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:57 smithi191 ceph-mon[24760]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:57 smithi170 ceph-mon[23733]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.743 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:19:57.744 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.wait_async( 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: return future.result(timeout) 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:57 smithi170 ceph-mon[28691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.c.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.745 INFO:journalctl@ceph.mon.c.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.746 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.wait_async( 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: return future.result(timeout) 2024-09-20T23:19:57.747 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.__get_result() 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: raise self._exception 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: raise OrchestratorError( 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.748 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.749 INFO:journalctl@ceph.mon.a.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.a.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:57 smithi170 ceph-mon[23733]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.__get_result() 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: raise self._exception 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: raise OrchestratorError( 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:19:57.750 INFO:journalctl@ceph.mon.c.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:19:57.751 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:19:57.752 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:19:57.752 INFO:journalctl@ceph.mon.c.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:19:57.752 INFO:journalctl@ceph.mon.c.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:19:57.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:57 smithi170 ceph-mon[28691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:19:57.817 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:19:57.818 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:19:58.164 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:19:58.164 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:19:58.164 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "", 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:19:58.165 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: Reconfiguring daemon agent.smithi191 on smithi191 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: Deploying cephadm binary to smithi191 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='client.25144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2460766603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: Reconfiguring daemon agent.smithi191 on smithi191 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: Deploying cephadm binary to smithi191 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='client.25144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2460766603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.572 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:19:58.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: Reconfiguring daemon agent.smithi191 on smithi191 2024-09-20T23:19:58.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: Deploying cephadm binary to smithi191 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='client.25144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2460766603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:58 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:19:58.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:19:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:19:58] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:19:59.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[28691]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:19:59.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[28691]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:19:59.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[28691]: from='client.25156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:59.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[28691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:59.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3040609839' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:19:59.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[23733]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:19:59.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[23733]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:19:59.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[23733]: from='client.25156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:59.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[23733]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:59.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:19:59 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3040609839' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:19:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:59 smithi191 ceph-mon[24760]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:19:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:59 smithi191 ceph-mon[24760]: Deploying daemon prometheus.a on smithi191 2024-09-20T23:19:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:59 smithi191 ceph-mon[24760]: from='client.25156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:59 smithi191 ceph-mon[24760]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:19:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:19:59 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3040609839' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:20:00.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:00 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:20:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:00 smithi170 ceph-mon[23733]: overall HEALTH_OK 2024-09-20T23:20:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:00 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:20:00.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:20:00] "GET /metrics HTTP/1.1" 200 38165 "" "Prometheus/2.33.4" 2024-09-20T23:20:01.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:01 smithi191 ceph-mon[24760]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:01.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:01 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:01 smithi170 ceph-mon[23733]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:01.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:01 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:01 smithi170 ceph-mon[28691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:01.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:01 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:02.243 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:20:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:20:01.970Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00401458s 2024-09-20T23:20:02.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:02 smithi191 ceph-mon[24760]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:02.718 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:02.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.191:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.170:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:02 smithi170 ceph-mon[23733]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:02 smithi170 ceph-mon[28691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:20:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:04 smithi170 ceph-mon[23733]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:04 smithi170 ceph-mon[28691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:04.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:04 smithi191 ceph-mon[24760]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:06.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:06 smithi170 ceph-mon[23733]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:06.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:06 smithi170 ceph-mon[28691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:06.834 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:06 smithi191 ceph-mon[24760]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:08.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:07 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2829640017' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:07 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2829640017' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:07 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2829640017' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:08.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[23962]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:20:08] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-20T23:20:09.423 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3393734468' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.423 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.424 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[23733]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:09.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3393734468' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:09 smithi170 ceph-mon[28691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:09 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3393734468' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:09 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]: dispatch 2024-09-20T23:20:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:09 smithi191 ceph-mon[24760]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:20:10.475 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 systemd[1]: Stopping Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:10.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]': finished 2024-09-20T23:20:10.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-mon[24760]: osdmap e99: 8 total, 8 up, 8 in 2024-09-20T23:20:10.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]: dispatch 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]': finished 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[28691]: osdmap e99: 8 total, 8 up, 8 in 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]: dispatch 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/2952835831"}]': finished 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[23733]: osdmap e99: 8 total, 8 up, 8 in 2024-09-20T23:20:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:10 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]: dispatch 2024-09-20T23:20:10.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.473Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.474Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.474Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[44130]: ts=2024-09-20T23:20:10.474Z caller=main.go:1066 level=info msg="See you next time!" 2024-09-20T23:20:10.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 podman[54094]: 2024-09-20 23:20:10.483465785 +0000 UTC m=+0.113318592 container died df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:11.134 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 podman[54094]: 2024-09-20 23:20:10.974124578 +0000 UTC m=+0.603977416 container cleanup df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:11.134 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:10 smithi191 bash[54094]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a 2024-09-20T23:20:11.409 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 podman[54105]: 2024-09-20 23:20:11.276211757 +0000 UTC m=+0.793775409 container remove df5fa7cfeb947552e2e03d52d0828c671c5259900c375720aa2b96358659afd3 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:11.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:11 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]': finished 2024-09-20T23:20:11.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:11 smithi191 ceph-mon[24760]: osdmap e100: 8 total, 8 up, 8 in 2024-09-20T23:20:11.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:11 smithi191 ceph-mon[24760]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:11.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:11 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1746448642' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:11 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]': finished 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[23733]: osdmap e100: 8 total, 8 up, 8 in 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[23733]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1746448642' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/266651490' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2874379495"}]': finished 2024-09-20T23:20:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[28691]: osdmap e100: 8 total, 8 up, 8 in 2024-09-20T23:20:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[28691]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1746448642' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:11 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]: dispatch 2024-09-20T23:20:11.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-20T23:20:11.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 systemd[1]: Stopped Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:11.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Consumed 1.825s CPU time. 2024-09-20T23:20:11.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 systemd[1]: Starting Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:12.110 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 podman[54234]: 2024-09-20 23:20:11.737277436 +0000 UTC m=+0.017217323 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-20T23:20:12.111 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:11 smithi191 podman[54234]: 2024-09-20 23:20:11.852271495 +0000 UTC m=+0.132211382 container create a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:12.111 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 podman[54234]: 2024-09-20 23:20:12.062700962 +0000 UTC m=+0.342640853 container init a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:12.111 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 podman[54234]: 2024-09-20 23:20:12.06543163 +0000 UTC m=+0.345371517 container start a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:12.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]': finished 2024-09-20T23:20:12.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-mon[24760]: osdmap e101: 8 total, 8 up, 8 in 2024-09-20T23:20:12.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2586469378' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.109Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.109Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.109Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi191 (none))" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.109Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.109Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.110Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.111Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.113Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.113Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.114Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-20T23:20:12.370 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.114Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.619µs 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.114Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.114Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.132Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.133Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.133Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=19.306µs wal_replay_duration=18.479527ms wbl_replay_duration=126ns total_replay_duration=18.516746ms 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.136Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.136Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.136Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.156Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.613522ms db_storage=1.089µs remote_storage=1.465µs web_handler=425ns query_engine=902ns scrape=565.026µs scrape_sd=91.696µs notify=15.308µs notify_sd=14.972µs rules=19.409035ms tracing=6.073µs 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.156Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:12.156Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-20T23:20:12.371 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 bash[54234]: a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da 2024-09-20T23:20:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]': finished 2024-09-20T23:20:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[23733]: osdmap e101: 8 total, 8 up, 8 in 2024-09-20T23:20:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2586469378' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/2698591188"}]': finished 2024-09-20T23:20:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[28691]: osdmap e101: 8 total, 8 up, 8 in 2024-09-20T23:20:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2586469378' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:12 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]: dispatch 2024-09-20T23:20:12.714 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:12 smithi191 systemd[1]: Started Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:13.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]': finished 2024-09-20T23:20:13.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: osdmap e102: 8 total, 8 up, 8 in 2024-09-20T23:20:13.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1172045852' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]': finished 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: osdmap e102: 8 total, 8 up, 8 in 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:20:13.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:13.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1172045852' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:13.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:13 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/2952835831"}]': finished 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: osdmap e102: 8 total, 8 up, 8 in 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: Deploying daemon node-exporter.b on smithi191 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1172045852' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:13 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]: dispatch 2024-09-20T23:20:14.602 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:14 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]': finished 2024-09-20T23:20:14.602 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:14 smithi191 ceph-mon[24760]: osdmap e103: 8 total, 8 up, 8 in 2024-09-20T23:20:14.602 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:14 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]: dispatch 2024-09-20T23:20:14.603 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:14 smithi191 systemd[1]: Stopping Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:14.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]': finished 2024-09-20T23:20:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[23733]: osdmap e103: 8 total, 8 up, 8 in 2024-09-20T23:20:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]: dispatch 2024-09-20T23:20:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/252561043"}]': finished 2024-09-20T23:20:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[28691]: osdmap e103: 8 total, 8 up, 8 in 2024-09-20T23:20:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:14 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]: dispatch 2024-09-20T23:20:14.901 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:14 smithi191 podman[54518]: 2024-09-20 23:20:14.600840142 +0000 UTC m=+0.139932422 container died 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:15.226 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:14 smithi191 podman[54518]: 2024-09-20 23:20:14.981799089 +0000 UTC m=+0.520891358 container cleanup 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:15.226 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:14 smithi191 bash[54518]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b 2024-09-20T23:20:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]': finished 2024-09-20T23:20:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[23733]: osdmap e104: 8 total, 8 up, 8 in 2024-09-20T23:20:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[23733]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/66978569' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]': finished 2024-09-20T23:20:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[28691]: osdmap e104: 8 total, 8 up, 8 in 2024-09-20T23:20:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[28691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/66978569' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:15 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:15 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4227926442' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1796673929"}]': finished 2024-09-20T23:20:15.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:15 smithi191 ceph-mon[24760]: osdmap e104: 8 total, 8 up, 8 in 2024-09-20T23:20:15.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:15 smithi191 ceph-mon[24760]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T23:20:15.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:15 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/66978569' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:15 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]: dispatch 2024-09-20T23:20:15.506 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 podman[54530]: 2024-09-20 23:20:15.250321805 +0000 UTC m=+0.653244513 container remove 88634964767c7d8a4ad0f2002a7b311665812a4a018af998f197cf1cf3e0bb68 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:15.506 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:20:15.506 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-20T23:20:15.506 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 systemd[1]: Stopped Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:15.506 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Consumed 3.342s CPU time. 2024-09-20T23:20:15.799 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 systemd[1]: Starting Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:16.202 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:15 smithi191 bash[54654]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-20T23:20:16.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:16 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]': finished 2024-09-20T23:20:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:16 smithi191 ceph-mon[24760]: osdmap e105: 8 total, 8 up, 8 in 2024-09-20T23:20:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:16 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:16.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:16 smithi191 bash[54654]: Getting image source signatures 2024-09-20T23:20:16.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:16 smithi191 bash[54654]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-20T23:20:16.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:16 smithi191 bash[54654]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-20T23:20:16.477 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:16 smithi191 bash[54654]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-20T23:20:16.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]': finished 2024-09-20T23:20:16.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[23733]: osdmap e105: 8 total, 8 up, 8 in 2024-09-20T23:20:16.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:16.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1939028319"}]': finished 2024-09-20T23:20:16.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[28691]: osdmap e105: 8 total, 8 up, 8 in 2024-09-20T23:20:16.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:16 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:17.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:17 smithi191 ceph-mon[24760]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:17 smithi170 ceph-mon[28691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:17 smithi170 ceph-mon[23733]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:17.976 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:17 smithi191 bash[54654]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-20T23:20:18.476 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:18 smithi191 bash[54654]: Writing manifest to image destination 2024-09-20T23:20:19.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:19 smithi170 ceph-mon[23733]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:19.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:19 smithi170 ceph-mon[23733]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:19.167 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:19 smithi170 ceph-mon[28691]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:19.167 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:19 smithi170 ceph-mon[28691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:19 smithi191 ceph-mon[24760]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:19 smithi191 ceph-mon[24760]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:19.924 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:19 smithi191 podman[54654]: 2024-09-20 23:20:19.571942008 +0000 UTC m=+3.866102630 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-20T23:20:20.226 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:19 smithi191 podman[54654]: 2024-09-20 23:20:19.92358515 +0000 UTC m=+4.217745764 container create 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:20.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-mon[24760]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-20T23:20:20.862 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 podman[54654]: 2024-09-20 23:20:20.573194194 +0000 UTC m=+4.867354812 container init 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:20.862 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 podman[54654]: 2024-09-20 23:20:20.576813574 +0000 UTC m=+4.870974187 container start 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:20:20.862 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.580Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.581Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.581Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=arp 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-20T23:20:20.863 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=edac 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-20T23:20:20.864 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-20T23:20:20.865 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=os 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.582Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=stat 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=time 2024-09-20T23:20:20.866 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=uname 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b[54771]: ts=2024-09-20T23:20:20.583Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 bash[54654]: 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 2024-09-20T23:20:20.867 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:20:20 smithi191 systemd[1]: Started Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:20 smithi170 ceph-mon[23733]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-20T23:20:20.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:20 smithi170 ceph-mon[28691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-20T23:20:21.869 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.869 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: Reconfiguring grafana.a (dependencies changed)... 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.870 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:21 smithi191 ceph-mon[24760]: Reconfiguring daemon grafana.a on smithi191 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: Reconfiguring grafana.a (dependencies changed)... 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[23733]: Reconfiguring daemon grafana.a on smithi191 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: Reconfiguring grafana.a (dependencies changed)... 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T23:20:21.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:21 smithi170 ceph-mon[28691]: Reconfiguring daemon grafana.a on smithi191 2024-09-20T23:20:22.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:22 smithi191 ceph-mon[24760]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:22.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:22 smithi170 ceph-mon[23733]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:22 smithi170 ceph-mon[28691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:23.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:23.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi191\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi191\", job=\"node\", machine=\"x86_64\", nodename=\"smithi191\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi191\", job=\"node\", machine=\"x86_64\", nodename=\"smithi191\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:24.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:24 smithi191 ceph-mon[24760]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:20:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:24 smithi170 ceph-mon[23733]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:20:24.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:24 smithi170 ceph-mon[28691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:20:26.194 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:20:25] "GET /metrics HTTP/1.1" 200 38159 "" "Prometheus/2.43.0" 2024-09-20T23:20:26.194 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:25 smithi191 systemd[1]: Stopping Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:26.194 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[42987]: t=2024-09-20T23:20:25+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-09-20T23:20:26.194 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:25 smithi191 podman[55209]: 2024-09-20 23:20:25.944144166 +0000 UTC m=+0.142122710 container died 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, version=8.5, build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Paul Cuzner , description=Ceph Grafana Container, vendor=Red Hat, Inc., architecture=x86_64, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, io.k8s.display-name=Red Hat Universal Base Image 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, name=ubi8, io.openshift.expose-services=, distribution-scope=public, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56) 2024-09-20T23:20:26.476 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 podman[55209]: 2024-09-20 23:20:26.283918003 +0000 UTC m=+0.481896539 container cleanup 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vcs-type=git, version=8.5, io.openshift.tags=base rhel8, release=236.1648460182, com.redhat.component=ubi8-container, io.openshift.expose-services=, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, distribution-scope=public, io.buildah.version=1.24.2) 2024-09-20T23:20:26.476 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 bash[55209]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a 2024-09-20T23:20:26.756 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:26 smithi191 ceph-mon[24760]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 podman[55242]: 2024-09-20 23:20:26.510361993 +0000 UTC m=+0.562371521 container remove 7e83a8882e655bb66858b88c0a9049d038cdab9a92dc1add70d90ae7708e629b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, description=Ceph Grafana Container, com.redhat.component=ubi8-container, io.buildah.version=1.24.2, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-03-28T10:36:18.413762, distribution-scope=public, io.openshift.tags=base rhel8, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, maintainer=Paul Cuzner , release=236.1648460182, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, vcs-type=git, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 bash[55257]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana.a" found: no such container 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 systemd[1]: Stopped Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@grafana.a.service: Consumed 2.609s CPU time. 2024-09-20T23:20:26.756 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:26 smithi191 systemd[1]: Starting Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:26 smithi170 ceph-mon[23733]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-09-20T23:20:26.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:26 smithi170 ceph-mon[28691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-09-20T23:20:27.591 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 podman[55355]: 2024-09-20 23:20:27.283193368 +0000 UTC m=+0.020364595 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-09-20T23:20:27.591 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 podman[55355]: 2024-09-20 23:20:27.466539305 +0000 UTC m=+0.203710526 container create db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.buildah.version=1.24.2, name=ubi8, description=Ceph Grafana Container, io.openshift.tags=base rhel8, build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, io.openshift.expose-services=, release=236.1648460182, com.redhat.component=ubi8-container, architecture=x86_64, maintainer=Paul Cuzner , vendor=Red Hat, Inc., vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-09-20T23:20:27.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:27] ENGINE Bus STOPPING 2024-09-20T23:20:27.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:20:27.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:27] ENGINE Bus STOPPED 2024-09-20T23:20:27.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:27] ENGINE Bus STARTING 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 podman[55355]: 2024-09-20 23:20:27.677290848 +0000 UTC m=+0.414462072 container init db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, build-date=2022-03-28T10:36:18.413762, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, version=8.5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, description=Ceph Grafana Container, vcs-type=git, distribution-scope=public, io.buildah.version=1.24.2, name=ubi8, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.expose-services=, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 podman[55355]: 2024-09-20 23:20:27.680166726 +0000 UTC m=+0.417337954 container start db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, io.openshift.tags=base rhel8, io.openshift.expose-services=, architecture=x86_64, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, vcs-type=git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=236.1648460182, io.buildah.version=1.24.2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, maintainer=Paul Cuzner , distribution-scope=public, vendor=Red Hat, Inc., name=ubi8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-09-20T23:20:27.977 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-09-20T23:20:27.978 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="App mode production" logger=settings 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=950.009µs 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 bash[55355]: db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 systemd[1]: Started Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-09-20T23:20:27.979 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="deleted datasource based on configuration" logger=provisioning.datasources name=Dashboard1 2024-09-20T23:20:27.980 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-20T23:20:27.980 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Loki uid=P8E80F9AEF21F6940 2024-09-20T23:20:27.980 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-09-20T23:20:27.980 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-09-20T23:20:27.980 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:20:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:20:27+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-09-20T23:20:28.372 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Serving on http://:::9283 2024-09-20T23:20:28.372 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STARTED 2024-09-20T23:20:28.372 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STOPPING 2024-09-20T23:20:28.633 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:20:28.633 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STOPPED 2024-09-20T23:20:28.633 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STARTING 2024-09-20T23:20:28.893 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:28.893 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Serving on http://:::9283 2024-09-20T23:20:28.893 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STARTED 2024-09-20T23:20:28.893 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:28] ENGINE Bus STOPPING 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.894 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:28.895 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:28 smithi191 ceph-mon[24760]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:28.934 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:20:28.934 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:28.934 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[28691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi191.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi191.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:28.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:28 smithi170 ceph-mon[23733]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:29.145 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:29] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:20:29.145 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:29] ENGINE Bus STOPPED 2024-09-20T23:20:29.145 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:29] ENGINE Bus STARTING 2024-09-20T23:20:29.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:29] ENGINE Serving on http://:::9283 2024-09-20T23:20:29.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:29] ENGINE Bus STARTED 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 starting - - - - 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 starting - - - - 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 starting - - - - 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 starting - - - - 2024-09-20T23:20:29.613 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (4m) 74s ago 4m 55.2M - 3.5 e1d6a67b021e 805a6a106ba3 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283 starting - - - - 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:9283 running (12m) 74s ago 12m 465M - 17.2.0 e1d6a67b021e d95903a05d4f 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (12m) 74s ago 12m 53.0M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (10m) 64s ago 10m 39.9M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (10m) 74s ago 10m 43.9M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 starting - - - - 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 starting - - - - 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 74s ago 10m 52.1M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 74s ago 9m 53.6M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 74s ago 9m 46.6M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (8m) 74s ago 8m 49.8M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (8m) 64s ago 8m 50.5M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (8m) 64s ago 8m 51.7M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:20:29.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (7m) 64s ago 7m 48.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (7m) 64s ago 7m 49.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 starting - - - - 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (4m) 74s ago 4m 69.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (4m) 64s ago 4m 71.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (4m) 74s ago 4m 69.4M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:20:29.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (4m) 64s ago 4m 69.1M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:20:30.017 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:20:30.018 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:20:30.366 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:20:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:20:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:20:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:20:30.366 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:20:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:20:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T23:20:30.367 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:20:30.367 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:20:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.y 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: Deploying daemon mgr.y on smithi170 2024-09-20T23:20:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:30 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3354671479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.y 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: Deploying daemon mgr.y on smithi170 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3354671479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.y 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:30.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:30.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: Deploying daemon mgr.y on smithi170 2024-09-20T23:20:30.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:30 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3354671479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:20:30.777 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[28691]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[28691]: from='client.25258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/783710129' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[23733]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[23733]: from='client.25258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:31.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:31 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/783710129' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:20:31.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:31 smithi191 ceph-mon[24760]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:31 smithi191 ceph-mon[24760]: from='client.25258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:31 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:31 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/783710129' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:20:31.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:31 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:32.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:32 smithi170 ceph-mon[23733]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:32.482 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:32 smithi170 podman[65839]: 2024-09-20 23:20:32.176757724 +0000 UTC m=+0.149927229 container died d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, RELEASE=HEAD, distribution-scope=public, GIT_BRANCH=HEAD, vcs-type=git, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, ceph=True, io.k8s.display-name=CentOS Stream 8, version=8, io.buildah.version=1.19.8, name=centos-stream, vendor=Red Hat, Inc.) 2024-09-20T23:20:32.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:32 smithi170 ceph-mon[28691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:32.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:32 smithi191 ceph-mon[24760]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:32.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:32 smithi170 podman[65839]: 2024-09-20 23:20:32.571139491 +0000 UTC m=+0.544308985 container cleanup d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, vcs-type=git, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, release=754, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, distribution-scope=public, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux ) 2024-09-20T23:20:32.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:32 smithi170 bash[65839]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:20:33.112 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:32 smithi170 podman[65851]: 2024-09-20 23:20:32.831197896 +0000 UTC m=+0.654403520 container remove d95903a05d4f8f440fe1d4ec4e299706f28ab88dde6986a403a1d1fbb0a5b912 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., RELEASE=HEAD, architecture=x86_64, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, release=754, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, vcs-type=git) 2024-09-20T23:20:33.113 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:32 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:20:33.113 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-20T23:20:33.113 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 systemd[1]: Stopped Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:33.113 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 1min 4.168s CPU time. 2024-09-20T23:20:33.426 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:33.678 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 podman[65980]: 2024-09-20 23:20:33.327430632 +0000 UTC m=+0.017589490 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:20:33.678 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 podman[65980]: 2024-09-20 23:20:33.457125644 +0000 UTC m=+0.147284485 container create 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:20:33.936 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:33.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 podman[65980]: 2024-09-20 23:20:33.676624647 +0000 UTC m=+0.366783509 container init 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 podman[65980]: 2024-09-20 23:20:33.680428928 +0000 UTC m=+0.370587771 container start 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 ceph-mgr[65999]: -- 172.21.15.170:0/4009596744 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5bbb990e0 con 0x55a5bbb77400 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 bash[65980]: 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:33.805+0000 7fd56766e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:20:33.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:33.871+0000 7fd56766e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:20:34.253 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.033+0000 7fd56766e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:20:34.254 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.100+0000 7fd56766e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:20:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:34 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.600 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.251+0000 7fd56766e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:20:34.600 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.398+0000 7fd56766e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:20:34.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.601 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:34.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:34.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:34.851 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.775+0000 7fd56766e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:20:35.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:34.849+0000 7fd56766e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:20:35.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:35 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:35.048+0000 7fd56766e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:20:35.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:35 smithi191 ceph-mon[24760]: Deploying daemon agent.smithi191 on smithi191 2024-09-20T23:20:35.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:35 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:35.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:35 smithi170 ceph-mon[23733]: Deploying daemon agent.smithi191 on smithi191 2024-09-20T23:20:35.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:35 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:35.596 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:35 smithi170 ceph-mon[28691]: Deploying daemon agent.smithi191 on smithi191 2024-09-20T23:20:35.596 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:35 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.161 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:36.084+0000 7fd56766e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:20:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:20:35] "GET /metrics HTTP/1.1" 200 38162 "" "Prometheus/2.43.0" 2024-09-20T23:20:36.450 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:36.158+0000 7fd56766e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:20:36.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:36.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: Deploying daemon agent.smithi170 on smithi170 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: Deploying daemon agent.smithi170 on smithi170 2024-09-20T23:20:36.451 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.452 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: Deploying daemon agent.smithi170 on smithi170 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:36.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:36.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:36.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:36.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:36 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:37.116 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:36.996+0000 7fd56766e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:20:37.378 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.114+0000 7fd56766e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:20:37.378 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.266+0000 7fd56766e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:20:37.378 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.330+0000 7fd56766e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:20:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:37 smithi191 ceph-mon[24760]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:37 smithi191 ceph-mon[24760]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:37.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[23733]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[23733]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.485+0000 7fd56766e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.554+0000 7fd56766e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.616+0000 7fd56766e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[28691]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:37.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-mon[28691]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:37.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.792+0000 7fd56766e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:20:37.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.858+0000 7fd56766e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:20:37.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:37.926+0000 7fd56766e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:20:38.266 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:38.011+0000 7fd56766e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:20:38.266 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:38.071+0000 7fd56766e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:20:38.266 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:38.132+0000 7fd56766e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:20:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:38 smithi191 ceph-mon[24760]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:38.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-mon[23733]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:38.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-mon[28691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:38.882 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:39.141 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:38.967+0000 7fd56766e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:20:39.141 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:38] ENGINE Bus STARTING 2024-09-20T23:20:39.141 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: CherryPy Checker: 2024-09-20T23:20:39.141 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: The Application mounted at '' has an empty config. 2024-09-20T23:20:39.142 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:38 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:39.142 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:39] ENGINE Serving on http://:::9283 2024-09-20T23:20:39.142 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:39] ENGINE Bus STARTED 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:20:39.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:20:39.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:39 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:39.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='client.15282 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:20:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:39 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:40.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:40 smithi170 ceph-mon[23733]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:40.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:40 smithi170 ceph-mon[23733]: mgrmap e27: x(active, since 69s), standbys: y 2024-09-20T23:20:40.663 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:40 smithi170 ceph-mon[28691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:40.663 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:40 smithi170 ceph-mon[28691]: mgrmap e27: x(active, since 69s), standbys: y 2024-09-20T23:20:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:40 smithi191 ceph-mon[24760]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:40 smithi191 ceph-mon[24760]: mgrmap e27: x(active, since 69s), standbys: y 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[23733]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[28691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.537 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:42 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:42 smithi191 ceph-mon[24760]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:20:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:42 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:42 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:42 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:43.786 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:43.890 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:43] ENGINE Bus STOPPING 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:43.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: Failing over to other MGR 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: osdmap e106: 8 total, 8 up, 8 in 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1125767646' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:43.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: Failing over to other MGR 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: osdmap e106: 8 total, 8 up, 8 in 2024-09-20T23:20:43.893 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:43 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1125767646' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:44.147 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: Failing over to other MGR 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 172.21.15.191:0/1477871787' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: osdmap e106: 8 total, 8 up, 8 in 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1125767646' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:43.793+0000 7f2a67747640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ignoring --setuser ceph since I am not root 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: ignoring --setgroup ceph since I am not root 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-mgr[50730]: -- 172.21.15.191:0/4173699792 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f66ae250e0 con 0x55f66ae03000 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:43.941+0000 7ff2e4c6f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:20:44.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:43.997+0000 7ff2e4c6f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:20:44.149 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.144+0000 7ff2e4c6f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:20:44.217 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:44] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:20:44.217 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:44] ENGINE Bus STOPPED 2024-09-20T23:20:44.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.211+0000 7ff2e4c6f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:20:44.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.359+0000 7ff2e4c6f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:20:44.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:44] ENGINE Bus STARTING 2024-09-20T23:20:44.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:44] ENGINE Serving on http://:::9283 2024-09-20T23:20:44.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:20:44] ENGINE Bus STARTED 2024-09-20T23:20:44.793 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.500+0000 7ff2e4c6f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:20:45.063 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.814+0000 7ff2e4c6f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:20:45.063 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:44.875+0000 7ff2e4c6f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:20:45.063 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.34877 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-20T23:20:45.063 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: mgrmap e28: y(active, starting, since 0.949708s) 2024-09-20T23:20:45.063 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:20:45.064 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: Manager daemon y is now available 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.065 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:44 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.34877 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: mgrmap e28: y(active, starting, since 0.949708s) 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:20:45.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: Manager daemon y is now available 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.34877 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-20T23:20:45.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: mgrmap e28: y(active, starting, since 0.949708s) 2024-09-20T23:20:45.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:20:45.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:20:45.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: Manager daemon y is now available 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:44 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-20T23:20:45.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:45.060+0000 7ff2e4c6f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:20:45.890 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:45.568+0000 7fd4bd61b640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:23:20:45] ENGINE Error in HTTPServer.serve 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self._connections.run(self.expiration_interval) 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self._run(expiration_interval) 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: s = self.context.wrap_socket( 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:20:45.891 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.sslsocket_class._create( 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self.do_handshake() 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self._sslobj.do_handshake() 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: mgrmap e29: y(active, since 1.96451s) 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: [20/Sep/2024:23:20:45] ENGINE Bus STARTING 2024-09-20T23:20:45.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: [20/Sep/2024:23:20:45] ENGINE Serving on http://172.21.15.170:8765 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: [20/Sep/2024:23:20:45] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: [20/Sep/2024:23:20:45] ENGINE Bus STARTED 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[23733]: [20/Sep/2024:23:20:45] ENGINE Error in HTTPServer.serve 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:20:45.893 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.do_handshake() 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:20:45.894 INFO:journalctl@ceph.mon.a.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: mgrmap e29: y(active, since 1.96451s) 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: [20/Sep/2024:23:20:45] ENGINE Bus STARTING 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: [20/Sep/2024:23:20:45] ENGINE Serving on http://172.21.15.170:8765 2024-09-20T23:20:45.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: [20/Sep/2024:23:20:45] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: [20/Sep/2024:23:20:45] ENGINE Bus STARTED 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:45 smithi170 ceph-mon[28691]: [20/Sep/2024:23:20:45] ENGINE Error in HTTPServer.serve 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:20:45.896 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.do_handshake() 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:20:45.897 INFO:journalctl@ceph.mon.c.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: mgrmap e29: y(active, since 1.96451s) 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: [20/Sep/2024:23:20:45] ENGINE Bus STARTING 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:20:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: [20/Sep/2024:23:20:45] ENGINE Serving on http://172.21.15.170:8765 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: [20/Sep/2024:23:20:45] ENGINE Serving on https://172.21.15.170:7150 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: [20/Sep/2024:23:20:45] ENGINE Bus STARTED 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-mon[24760]: [20/Sep/2024:23:20:45] ENGINE Error in HTTPServer.serve 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._run(expiration_interval) 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:20:45.978 INFO:journalctl@ceph.mon.b.smithi191.stdout: s = self.context.wrap_socket( 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.sslsocket_class._create( 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.do_handshake() 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._sslobj.do_handshake() 2024-09-20T23:20:45.979 INFO:journalctl@ceph.mon.b.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:20:46.264 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:45.984+0000 7ff2e4c6f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:20:46.264 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:46.080+0000 7ff2e4c6f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:20:47.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:47.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: mgrmap e30: y(active, since 2s) 2024-09-20T23:20:47.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: mgrmap e30: y(active, since 2s) 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.057 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.058 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:46 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:47.106 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:46.899+0000 7ff2e4c6f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:20:47.106 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.026+0000 7ff2e4c6f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:20:47.106 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: mgrmap e30: y(active, since 2s) 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.107 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:20:47.108 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:46 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:47.400 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.180+0000 7ff2e4c6f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:20:47.400 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.244+0000 7ff2e4c6f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:20:47.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.398+0000 7ff2e4c6f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:20:47.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.491+0000 7ff2e4c6f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:20:47.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.569+0000 7ff2e4c6f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:20:48.019 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.753+0000 7ff2e4c6f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:20:48.019 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.829+0000 7ff2e4c6f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:20:48.019 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.896+0000 7ff2e4c6f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:20:48.019 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:47.982+0000 7ff2e4c6f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:20:48.179 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:48.179 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:48.179 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: mgrmap e31: y(active, since 4s) 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.180 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.181 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: mgrmap e31: y(active, since 4s) 2024-09-20T23:20:48.182 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.182 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.182 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:48 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:48.045+0000 7ff2e4c6f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:48.111+0000 7ff2e4c6f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: mgrmap e31: y(active, since 4s) 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: Standby manager daemon x started 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:20:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:48.944+0000 7ff2e4c6f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:48] ENGINE Bus STARTING 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: CherryPy Checker: 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: The Application mounted at '' has an empty config. 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:49] ENGINE Serving on http://:::9283 2024-09-20T23:20:49.228 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[50726]: [20/Sep/2024:23:20:49] ENGINE Bus STARTED 2024-09-20T23:20:49.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: Standby manager daemon x started 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: Standby manager daemon x started 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:20:49.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:49 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/74433052' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:20:50.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:50 smithi191 ceph-mon[24760]: mgrmap e32: y(active, since 6s), standbys: x 2024-09-20T23:20:50.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:50 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:20:50.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:50 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:50 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:50 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[23733]: mgrmap e32: y(active, since 6s), standbys: x 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[28691]: mgrmap e32: y(active, since 6s), standbys: x 2024-09-20T23:20:50.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:20:50.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:50.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:50 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:51.439 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:20:51.173+0000 7fd4f790c640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:51.439 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Creating ceph-iscsi config... 2024-09-20T23:20:51.439 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:51.439 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return _run_code(code, main_globals, None, 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: exec(code, run_globals) 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:51.440 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:51.441 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:51.441 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:51.441 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:51.441 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.wait_async( 2024-09-20T23:20:51.442 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return future.result(timeout) 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.__get_result() 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: raise self._exception 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: out, err, code = await self._run_cephadm( 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:20:51.443 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: raise OrchestratorError( 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Creating ceph-iscsi config... 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return _run_code(code, main_globals, None, 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: exec(code, run_globals) 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:51.444 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:51.445 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:51.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-mon[23733]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:51 smithi170 ceph-mon[28691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:51.907 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:51 smithi191 ceph-mon[24760]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: exec(code, run_globals) 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.wait_async( 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: return future.result(timeout) 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.__get_result() 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: raise self._exception 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:20:52.889 INFO:journalctl@ceph.mon.b.smithi191.stdout: raise OrchestratorError( 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: exec(code, run_globals) 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.890 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.891 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:52 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.955 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.956 INFO:journalctl@ceph.mon.a.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.wait_async( 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: return future.result(timeout) 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:20:52.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.wait_async( 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:20:52.959 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.c.smithi170.stdout: return future.result(timeout) 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.__get_result() 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: raise self._exception 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: raise OrchestratorError( 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.960 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.961 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.__get_result() 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.c.smithi170.stdout: raise self._exception 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:20:52.962 INFO:journalctl@ceph.mon.c.smithi170.stdout: out, err, code = await self._run_cephadm( 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: raise OrchestratorError( 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: Creating ceph-iscsi config... 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:20:52.963 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:52.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:52 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.861 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:53 smithi191 ceph-mon[24760]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:20:53.861 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:53 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.862 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:53 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.862 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:53 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.862 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:20:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[23733]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:20:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[28691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:20:53.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:53.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:53 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:55.227 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 systemd[1]: Stopping Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:55.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-mon[24760]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.317Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-20T23:20:55.611 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.318Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-20T23:20:55.612 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.318Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-20T23:20:55.612 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.318Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-20T23:20:55.612 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[54249]: ts=2024-09-20T23:20:55.318Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-20T23:20:55.612 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 podman[58387]: 2024-09-20 23:20:55.32780458 +0000 UTC m=+0.101847565 container died a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:55.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:55 smithi170 ceph-mon[23733]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:20:55.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:55 smithi170 ceph-mon[28691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:20:55.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 podman[58387]: 2024-09-20 23:20:55.709112904 +0000 UTC m=+0.483155882 container cleanup a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:55.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 bash[58387]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a 2024-09-20T23:20:56.343 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:55 smithi191 podman[58399]: 2024-09-20 23:20:55.976909711 +0000 UTC m=+0.647391777 container remove a6f8f584b54208ae6bfb0abe6f837230b3f6b578ad718333d4eec71e287014da (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:56.343 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-20T23:20:56.343 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 systemd[1]: Stopped Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:56.343 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Consumed 1.166s CPU time. 2024-09-20T23:20:56.344 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 systemd[1]: Starting Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:20:56.615 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 podman[58492]: 2024-09-20 23:20:56.245884319 +0000 UTC m=+0.016847209 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-20T23:20:56.615 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 podman[58492]: 2024-09-20 23:20:56.353035127 +0000 UTC m=+0.123998050 container create ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:56.615 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 podman[58492]: 2024-09-20 23:20:56.614536976 +0000 UTC m=+0.385499862 container init ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:56.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:20:56.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:56.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:56.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 podman[58492]: 2024-09-20 23:20:56.617581178 +0000 UTC m=+0.388544063 container start ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:20:56.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.640Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-20T23:20:56.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.640Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-20T23:20:56.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.640Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi191 (none))" 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.640Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.640Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.642Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.642Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.643Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.643Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.644Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.644Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.335µs 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.644Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.645Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.663Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.669Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.669Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-09-20T23:20:56.978 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.669Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=19.678µs wal_replay_duration=24.752013ms wbl_replay_duration=125ns total_replay_duration=24.7975ms 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.672Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.672Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.672Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.694Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.572663ms db_storage=834ns remote_storage=1.118µs web_handler=357ns query_engine=836ns scrape=383.367µs scrape_sd=120.588µs notify=11.99µs notify_sd=9.605µs rules=20.697466ms tracing=5.686µs 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.694Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:20:56.694Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 bash[58492]: ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 2024-09-20T23:20:56.979 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:20:56 smithi191 systemd[1]: Started Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:56 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:58.039 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:57 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:58.039 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:57 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.040 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:57 smithi191 ceph-mon[24760]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[23733]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:57 smithi170 ceph-mon[28691]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-20T23:20:58.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.x 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:58 smithi191 ceph-mon[24760]: Deploying daemon mgr.x on smithi191 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.x 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[23733]: Deploying daemon mgr.x on smithi191 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.x 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:58 smithi170 ceph-mon[28691]: Deploying daemon mgr.x on smithi191 2024-09-20T23:20:59.975 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:20:59 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:20:59.975 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:59 smithi191 systemd[1]: Stopping Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:00.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:20:59 smithi191 podman[58828]: 2024-09-20 23:20:59.973290553 +0000 UTC m=+0.143532664 container died d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:21:00.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:20:59 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:00.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:20:59 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:00.619 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 podman[58828]: 2024-09-20 23:21:00.350959184 +0000 UTC m=+0.521201285 container cleanup d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:21:00.620 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 bash[58828]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x 2024-09-20T23:21:00.879 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:00 smithi191 ceph-mon[24760]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:00.880 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 podman[58840]: 2024-09-20 23:21:00.618700916 +0000 UTC m=+0.646705883 container remove d0a4209037cdb7060c0924b8ff580e1da3076db6b5137cc24594ded225bfae63 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:21:00.880 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:21:00.880 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Failed with result 'exit-code'. 2024-09-20T23:21:00.880 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 systemd[1]: Stopped Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:00.880 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service: Consumed 20.464s CPU time. 2024-09-20T23:21:01.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:00 smithi170 ceph-mon[23733]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:01.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:00 smithi170 ceph-mon[28691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:01.144 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:21:01.193 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:00 smithi191 systemd[1]: Starting Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:01.451 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 podman[58971]: 2024-09-20 23:21:01.09481199 +0000 UTC m=+0.016025268 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:21:01.451 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 podman[58971]: 2024-09-20 23:21:01.211496783 +0000 UTC m=+0.132710052 container create a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-20T23:21:01.451 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 podman[58971]: 2024-09-20 23:21:01.422795914 +0000 UTC m=+0.344009201 container init a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:21:01.451 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 podman[58971]: 2024-09-20 23:21:01.425636403 +0000 UTC m=+0.346849675 container start a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-20T23:21:01.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-mgr[58991]: -- 172.21.15.191:0/1189516125 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f75a15b0e0 con 0x55f75a138800 2024-09-20T23:21:01.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 bash[58971]: a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d 2024-09-20T23:21:01.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 systemd[1]: Started Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:01.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:01.546+0000 7f45d93eb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:21:01.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:01.610+0000 7f45d93eb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:01.867 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 6s ago 11m - - 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 9s ago 11m - - 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (70s) 6s ago 6m 17.7M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (34s) 9s ago 6m 41.9M - dad864ee21e9 db20e8680365 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (19s) 6s ago 4m 46.1M - 3.5 e1d6a67b021e 1dbd4c8458a3 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 starting - - - - 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (28s) 6s ago 12m 485M - 19.1.1-367-g9e2ac70b cc9251b744a3 6d25e1020cfd 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (12m) 6s ago 12m 61.5M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (11m) 9s ago 11m 52.5M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (11m) 6s ago 11m 52.5M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (81s) 6s ago 7m 7968k - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:21:01.868 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (42s) 9s ago 6m 7490k - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 6s ago 10m 54.5M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 6s ago 10m 55.3M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 6s ago 9m 48.0M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (9m) 6s ago 9m 51.8M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (9m) 9s ago 9m 52.7M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (8m) 9s ago 8m 52.4M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (8m) 9s ago 8m 48.8M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (7m) 9s ago 7m 51.2M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 starting - - - - 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (5m) 6s ago 5m 71.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (5m) 9s ago 5m 73.3M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (5m) 6s ago 5m 71.4M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:21:01.869 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (5m) 9s ago 5m 71.1M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:21:02.118 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:01.764+0000 7f45d93eb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:21:02.119 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:01.831+0000 7f45d93eb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:21:02.119 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:01.976+0000 7f45d93eb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:02.119 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:02.116+0000 7f45d93eb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:21:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:21:02.289 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:21:02.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='client.25333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:21:02.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/4025480398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='client.25333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:21:02.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:02 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/4025480398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:21:02.655 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T23:21:02.656 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:21:02.656 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:21:02.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:02.430+0000 7f45d93eb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:21:02.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:02.491+0000 7f45d93eb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:02.678+0000 7f45d93eb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='client.25333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: Reconfiguring iscsi.foo.smithi170.ykmvuq (dependencies changed)... 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:21:02.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:02.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: Reconfiguring daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:21:02.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:02 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/4025480398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:03.078 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[23733]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[23733]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[23733]: from='client.25357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3541469014' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1396687323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[28691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[28691]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[28691]: from='client.25357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3541469014' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:03.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:03 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1396687323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:03.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:03.577+0000 7f45d93eb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:03.644+0000 7f45d93eb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-mon[24760]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-mon[24760]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-mon[24760]: from='client.25357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3541469014' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:03.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1396687323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:03.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:03.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:04.633 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.370+0000 7f45d93eb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:21:04.633 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.487+0000 7f45d93eb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:21:04.911 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.631+0000 7f45d93eb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:04.911 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.692+0000 7f45d93eb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:21:04.911 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.842+0000 7f45d93eb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:21:04.911 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.909+0000 7f45d93eb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:21:05.195 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:04.970+0000 7f45d93eb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:21:05.196 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.129+0000 7f45d93eb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:21:05.196 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.193+0000 7f45d93eb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:21:05.462 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.260+0000 7f45d93eb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:21:05.462 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.341+0000 7f45d93eb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:05.462 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.400+0000 7f45d93eb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:21:05.462 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:05.460+0000 7f45d93eb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:21:05.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[28691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:05.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[28691]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[28691]: osdmap e107: 8 total, 8 up, 8 in 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[23733]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[23733]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mon[23733]: osdmap e107: 8 total, 8 up, 8 in 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:05.433+0000 7fd4f790c640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi-foo-smithi170-ykmvuq 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: /usr/bin/podman: stderr Error: no such container ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi-foo-smithi170-ykmvuq 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: /usr/bin/podman: stderr Error: no such container ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:21:05.632 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Creating ceph-iscsi config... 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return _run_code(code, main_globals, None, 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: exec(code, run_globals) 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:21:05.633 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-20T23:21:05.634 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.wait_async( 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.event_loop.get_result(coro, timeout) 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return future.result(timeout) 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return self.__get_result() 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: raise self._exception 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: out, err, code = await self._run_cephadm( 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: raise OrchestratorError( 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi-foo-smithi170-ykmvuq 2024-09-20T23:21:05.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: /usr/bin/podman: stderr Error: no such container ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi-foo-smithi170-ykmvuq 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: /usr/bin/podman: stderr Error: no such container ceph-243152d6-77a5-11ef-baf5-efdc52797490-iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Reconfig daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Creating ceph-iscsi config... 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Non-zero exit code 1 from systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:21:05.636 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: Traceback (most recent call last): 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: return _run_code(code, main_globals, None, 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: exec(code, run_globals) 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-20T23:21:05.637 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:21:05.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: RuntimeError: Failed command: systemctl restart ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:21:05.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:21:05.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:05.595+0000 7fd5625ff640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-20T23:21:05.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-mon[24760]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:05.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-mon[24760]: from='mgr.15375 172.21.15.170:0/2524519057' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-20T23:21:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:05 smithi191 ceph-mon[24760]: osdmap e107: 8 total, 8 up, 8 in 2024-09-20T23:21:05.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: ignoring --setuser ceph since I am not root 2024-09-20T23:21:05.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: ignoring --setgroup ceph since I am not root 2024-09-20T23:21:05.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-mgr[65999]: -- 172.21.15.170:0/391123043 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5618b2a730e0 con 0x5618b2a51000 2024-09-20T23:21:05.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:05.749+0000 7f5fceade040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:21:05.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:05.807+0000 7f5fceade040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:06.187 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:05.958+0000 7f5fceade040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:21:06.187 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.024+0000 7f5fceade040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:21:06.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.184+0000 7f5fceade040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:06.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.324+0000 7f5fceade040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:06.338+0000 7f45d93eb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE Bus STARTING 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: CherryPy Checker: 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: The Application mounted at '' has an empty config. 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE Serving on http://:::9283 2024-09-20T23:21:06.602 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE Bus STARTED 2024-09-20T23:21:06.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.658+0000 7f5fceade040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:21:06.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.719+0000 7f5fceade040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:21:06.810 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: from='mgr.15375 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:21:06.810 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: mgrmap e33: x(active, starting, since 0.115809s) 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: Active manager daemon x restarted 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: Activating manager daemon x 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: osdmap e108: 8 total, 8 up, 8 in 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:21:06.811 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: from='mgr.15375 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: mgrmap e33: x(active, starting, since 0.115809s) 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: Active manager daemon x restarted 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: Activating manager daemon x 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: osdmap e108: 8 total, 8 up, 8 in 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:21:06.812 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:06.813 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:21:06.813 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:06.959 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE Bus STOPPING 2024-09-20T23:21:06.959 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: from='mgr.15375 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: mgrmap e33: x(active, starting, since 0.115809s) 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: Active manager daemon x restarted 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: Activating manager daemon x 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: osdmap e108: 8 total, 8 up, 8 in 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-20T23:21:06.960 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:07.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:06] ENGINE Bus STOPPED 2024-09-20T23:21:07.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:07] ENGINE Bus STARTING 2024-09-20T23:21:07.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:07] ENGINE Serving on http://:::9283 2024-09-20T23:21:07.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:21:07] ENGINE Bus STARTED 2024-09-20T23:21:07.242 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:06.922+0000 7f5fceade040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: mgrmap e34: x(active, starting, since 0.266258s) 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:21:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: Manager daemon x is now available 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: mgrmap e34: x(active, starting, since 0.266258s) 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:21:07.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: Manager daemon x is now available 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: mgrmap e34: x(active, starting, since 0.266258s) 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:21:07.895 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: Manager daemon x is now available 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:07.896 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:07.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:21:08.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:07.889+0000 7f5fceade040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:21:08.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:07.958+0000 7f5fceade040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:08.436+0000 7f4534be3640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:23:21:08] ENGINE Error in HTTPServer.serve 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: Traceback (most recent call last): 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._connections.run(self.expiration_interval) 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._run(expiration_interval) 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:21:08.588 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: s = self.context.wrap_socket( 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: return self.sslsocket_class._create( 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self.do_handshake() 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._sslobj.do_handshake() 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:21:08.589 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:21:08.880 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:08.740+0000 7f5fceade040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:21:08.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: mgrmap e35: x(active, since 1.27448s) 2024-09-20T23:21:08.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: [20/Sep/2024:23:21:08] ENGINE Bus STARTING 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: [20/Sep/2024:23:21:08] ENGINE Serving on https://172.21.15.191:7151 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[23733]: [20/Sep/2024:23:21:08] ENGINE Error in HTTPServer.serve 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:21:08.882 INFO:journalctl@ceph.mon.a.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.do_handshake() 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.a.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: mgrmap e35: x(active, since 1.27448s) 2024-09-20T23:21:08.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: [20/Sep/2024:23:21:08] ENGINE Bus STARTING 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: [20/Sep/2024:23:21:08] ENGINE Serving on https://172.21.15.191:7151 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-mon[28691]: [20/Sep/2024:23:21:08] ENGINE Error in HTTPServer.serve 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:21:08.884 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.do_handshake() 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:21:08.885 INFO:journalctl@ceph.mon.c.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: mgrmap e35: x(active, since 1.27448s) 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:21:08.886 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: [20/Sep/2024:23:21:08] ENGINE Bus STARTING 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: [20/Sep/2024:23:21:08] ENGINE Serving on https://172.21.15.191:7151 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:08 smithi191 ceph-mon[24760]: [20/Sep/2024:23:21:08] ENGINE Error in HTTPServer.serve 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._run(expiration_interval) 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: s = self.context.wrap_socket( 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.sslsocket_class._create( 2024-09-20T23:21:08.887 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:21:08.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.do_handshake() 2024-09-20T23:21:08.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:21:08.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._sslobj.do_handshake() 2024-09-20T23:21:08.888 INFO:journalctl@ceph.mon.b.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:21:09.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:08.877+0000 7f5fceade040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:21:09.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.048+0000 7f5fceade040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:09.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.125+0000 7f5fceade040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:21:09.576 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.322+0000 7f5fceade040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:21:09.576 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.410+0000 7f5fceade040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:21:09.576 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.487+0000 7f5fceade040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:21:09.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.656+0000 7f5fceade040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:21:09.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.734+0000 7f5fceade040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:21:09.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.802+0000 7f5fceade040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:21:09.888 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.884+0000 7f5fceade040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: [20/Sep/2024:23:21:08] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: [20/Sep/2024:23:21:08] ENGINE Bus STARTED 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: mgrmap e36: x(active, since 2s) 2024-09-20T23:21:09.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:09.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: [20/Sep/2024:23:21:08] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: [20/Sep/2024:23:21:08] ENGINE Bus STARTED 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.891 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: mgrmap e36: x(active, since 2s) 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.892 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:09.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:09.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: [20/Sep/2024:23:21:08] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: [20/Sep/2024:23:21:08] ENGINE Bus STARTED 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: mgrmap e36: x(active, since 2s) 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:21:09.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:09.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:21:10.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:09.945+0000 7f5fceade040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:21:10.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:10.006+0000 7f5fceade040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:21:10.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:10.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:10.955+0000 7f5fceade040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:21:11.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:21:10] ENGINE Bus STARTING 2024-09-20T23:21:11.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: CherryPy Checker: 2024-09-20T23:21:11.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: The Application mounted at '' has an empty config. 2024-09-20T23:21:11.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: 2024-09-20T23:21:11.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:21:11] ENGINE Serving on http://:::9283 2024-09-20T23:21:11.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: [20/Sep/2024:23:21:11] ENGINE Bus STARTED 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: mgrmap e37: x(active, since 4s) 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[23733]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: mgrmap e37: x(active, since 4s) 2024-09-20T23:21:11.964 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:11.965 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:11 smithi170 ceph-mon[28691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:21:11.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: mgrmap e37: x(active, since 4s) 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: Reconfiguring daemon prometheus.a on smithi191 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:21:11.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:11.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:11.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:11.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3821830905' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:11.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:11 smithi191 ceph-mon[24760]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: mgrmap e38: x(active, since 5s), standbys: y 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: mgrmap e38: x(active, since 5s), standbys: y 2024-09-20T23:21:12.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: mgrmap e38: x(active, since 5s), standbys: y 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:12.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:13.657 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.218 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[23733]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 46 op/s 2024-09-20T23:21:15.218 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[28691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 46 op/s 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.219 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:15 smithi191 ceph-mon[24760]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 46 op/s 2024-09-20T23:21:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:15.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-20T23:21:16.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:21:16.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.569 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:16 smithi191 systemd[1]: Stopping Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T23:21:16.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:16.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:16 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[65995]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:21:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-20T23:21:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:17 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1288655567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:17 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1288655567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:17.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1288655567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:21:17.582 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:21:17.582 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-20T23:21:17.582 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.312Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.313Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.313Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.313Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[58507]: ts=2024-09-20T23:21:17.313Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-20T23:21:17.583 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 podman[61357]: 2024-09-20 23:21:17.322728172 +0000 UTC m=+0.117317287 container died ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:17.965 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 podman[61357]: 2024-09-20 23:21:17.679774759 +0000 UTC m=+0.474363873 container cleanup ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:17.966 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 bash[61357]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a 2024-09-20T23:21:18.226 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:17 smithi191 podman[61369]: 2024-09-20 23:21:17.964423247 +0000 UTC m=+0.642892135 container remove ca6526cb1879634240a6b0962c259e2e4112a8a572dea23c04f76fa0f2e4a740 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:18.226 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-20T23:21:18.227 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 systemd[1]: Stopped Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:18.227 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service: Consumed 1.034s CPU time. 2024-09-20T23:21:18.227 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 systemd[1]: Starting Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:18.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-mon[24760]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-20T23:21:18.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2060108570' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.604 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 podman[61475]: 2024-09-20 23:21:18.243724629 +0000 UTC m=+0.022241554 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-20T23:21:18.605 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 podman[61475]: 2024-09-20 23:21:18.340476973 +0000 UTC m=+0.118993877 container create 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:18.605 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 podman[61475]: 2024-09-20 23:21:18.57638203 +0000 UTC m=+0.354898948 container init 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:18.605 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 podman[61475]: 2024-09-20 23:21:18.579243537 +0000 UTC m=+0.357760459 container start 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[28691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2060108570' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[23733]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2060108570' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:18 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]: dispatch 2024-09-20T23:21:18.897 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.603Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-20T23:21:18.897 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.603Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.603Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi191 (none))" 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.603Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.603Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.605Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.605Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-20T23:21:18.898 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.606Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.606Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.609Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.609Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.64µs 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.609Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.609Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-09-20T23:21:18.899 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.625Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.631Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.633Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.633Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.633Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.997µs wal_replay_duration=24.285734ms wbl_replay_duration=109ns total_replay_duration=24.325781ms 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.636Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.636Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-20T23:21:18.900 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.636Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-20T23:21:18.901 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.655Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.371174ms db_storage=902ns remote_storage=1.029µs web_handler=339ns query_engine=1.087µs scrape=237.996µs scrape_sd=87.967µs notify=14.309µs notify_sd=12.361µs rules=18.716901ms tracing=5.399µs 2024-09-20T23:21:18.901 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.655Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-20T23:21:18.901 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:18.655Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-20T23:21:18.901 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 bash[61475]: 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd 2024-09-20T23:21:18.902 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:18 smithi191 systemd[1]: Started Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:19.462 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]': finished 2024-09-20T23:21:19.462 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: osdmap e109: 8 total, 8 up, 8 in 2024-09-20T23:21:19.462 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]: dispatch 2024-09-20T23:21:19.462 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]': finished 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: osdmap e109: 8 total, 8 up, 8 in 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]: dispatch 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:19.463 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1188311791"}]': finished 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: osdmap e109: 8 total, 8 up, 8 in 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]: dispatch 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]': finished 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: osdmap e110: 8 total, 8 up, 8 in 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]: dispatch 2024-09-20T23:21:20.545 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.546 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.546 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:20.546 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:20 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:20.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:20.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]': finished 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: osdmap e110: 8 total, 8 up, 8 in 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s 2024-09-20T23:21:20.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/393954240' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6801/4267328228"}]': finished 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: osdmap e110: 8 total, 8 up, 8 in 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]: dispatch 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:20.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:20 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:21.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.y 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]': finished 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: osdmap e111: 8 total, 8 up, 8 in 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3859703567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:21.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.y 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]': finished 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: osdmap e111: 8 total, 8 up, 8 in 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3859703567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:21.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:21 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.y 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1061976136' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1816981896"}]': finished 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: osdmap e111: 8 total, 8 up, 8 in 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3859703567' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:21 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]: dispatch 2024-09-20T23:21:22.075 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:21 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:22.353 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 podman[72694]: 2024-09-20 23:21:22.073956252 +0000 UTC m=+0.140794853 container died 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 podman[72694]: 2024-09-20 23:21:22.442488422 +0000 UTC m=+0.509327030 container cleanup 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=) 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 bash[72694]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]': finished 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: osdmap e112: 8 total, 8 up, 8 in 2024-09-20T23:21:22.684 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1715070538' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]': finished 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: osdmap e112: 8 total, 8 up, 8 in 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1715070538' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:22.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:22 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:22.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/3115781696"}]': finished 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: osdmap e112: 8 total, 8 up, 8 in 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1715070538' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]: dispatch 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:22.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:22 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:22.991 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 podman[72706]: 2024-09-20 23:21:22.730746021 +0000 UTC m=+0.655523082 container remove 6d25e1020cfd993ca2d8cc472a0a633cd51752491a5eb249eb0f887f1b906a84 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-20T23:21:22.991 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:21:22.991 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-20T23:21:22.991 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 systemd[1]: Stopped Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:22.991 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:22 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 20.295s CPU time. 2024-09-20T23:21:23.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:23.599 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 podman[72856]: 2024-09-20 23:21:23.210548211 +0000 UTC m=+0.016345999 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:21:23.599 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 podman[72856]: 2024-09-20 23:21:23.336801256 +0000 UTC m=+0.142599024 container create 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:21:23.599 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 podman[72856]: 2024-09-20 23:21:23.597836124 +0000 UTC m=+0.403633892 container init 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[23733]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]': finished 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[23733]: osdmap e113: 8 total, 8 up, 8 in 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3728170503' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:23.953 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 podman[72856]: 2024-09-20 23:21:23.601140237 +0000 UTC m=+0.406938009 container start 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mgr[72875]: -- 172.21.15.170:0/3934668096 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555aeac710e0 con 0x555aeac4f000 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 bash[72856]: 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:23.729+0000 7f367f0be040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:23.792+0000 7f367f0be040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[28691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]': finished 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[28691]: osdmap e113: 8 total, 8 up, 8 in 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3728170503' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:23.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:23.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:23.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-mon[24760]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-20T23:21:23.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:6800/4267328228"}]': finished 2024-09-20T23:21:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-mon[24760]: osdmap e113: 8 total, 8 up, 8 in 2024-09-20T23:21:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3728170503' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:23 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]: dispatch 2024-09-20T23:21:24.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:23.950+0000 7f367f0be040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:21:24.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.019+0000 7f367f0be040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:21:24.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.175+0000 7f367f0be040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:24.608 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.322+0000 7f367f0be040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:21:24.927 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.667+0000 7f367f0be040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:21:24.927 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.733+0000 7f367f0be040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]': finished 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.928 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Upgrade: Setting container_image for all mgr 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.929 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]': finished 2024-09-20T23:21:24.930 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Upgrade: Setting container_image for all mgr 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.932 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.933 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.936 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.938 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='client.? ' entity='client.iscsi.foo.smithi170.ykmvuq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.170:0/1887198576"}]': finished 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Upgrade: Setting container_image for all mgr 2024-09-20T23:21:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:24 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:24 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:24.930+0000 7f367f0be040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:21:25.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.915 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.916 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.918 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.919 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.920 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.921 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.922 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.923 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.924 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.925 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:21:25] "GET /metrics HTTP/1.1" 200 38258 "" "Prometheus/2.43.0" 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:25.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:25 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.187 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:25.911+0000 7f367f0be040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:21:26.187 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:25 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:25.984+0000 7f367f0be040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:21:26.816 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:26.799+0000 7f367f0be040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:21:26.816 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.816 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.816 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.816 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.818 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.819 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.820 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.821 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.822 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.823 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.824 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.825 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:26.826 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:26.827 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:26.827 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:26.827 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:26.827 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.089 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:26 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:26.930+0000 7f367f0be040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:26 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.392 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.087+0000 7f367f0be040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:27.392 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.152+0000 7f367f0be040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:21:27.392 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.319+0000 7f367f0be040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:21:27.392 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.390+0000 7f367f0be040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:21:27.694 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.457+0000 7f367f0be040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:21:27.695 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.622+0000 7f367f0be040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:21:27.695 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.693+0000 7f367f0be040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:21:27.992 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.776+0000 7f367f0be040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:21:27.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.862+0000 7f367f0be040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:27.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.927+0000 7f367f0be040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:21:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:27 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:27.990+0000 7f367f0be040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:21:28.957 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:28.860+0000 7f367f0be040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: [20/Sep/2024:23:21:28] ENGINE Bus STARTING 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: CherryPy Checker: 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: The Application mounted at '' has an empty config. 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.961 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.962 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.963 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.964 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.967 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:28.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: [20/Sep/2024:23:21:28] ENGINE Serving on http://:::9283 2024-09-20T23:21:29.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[72871]: [20/Sep/2024:23:21:28] ENGINE Bus STARTED 2024-09-20T23:21:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:21:29.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:21:30.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:30.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:30.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2928642321' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.244 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.248 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:30.249 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.250 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:30.251 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: mgrmap e39: x(active, since 23s), standbys: y 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: mgrmap e39: x(active, since 23s), standbys: y 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: mgrmap e39: x(active, since 23s), standbys: y 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.254 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:32.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:32.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.094 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.169 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.170 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.171 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.172 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.173 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.175 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.176 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.177 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.178 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:33.179 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:33.451 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:21:33.834 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:34.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.116 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='client.25489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='client.25489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.122 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 18s ago 12m - - 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 13s ago 12m - - 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (102s) 18s ago 6m 17.7M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (66s) 13s ago 6m 45.0M - dad864ee21e9 db20e8680365 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 unknown 18s ago 5m - - 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (33s) 13s ago 11m 490M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 starting - - - - 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (13m) 18s ago 13m 64.1M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:21:34.145 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (11m) 13s ago 11m 58.8M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (11m) 18s ago 11m 56.4M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (113s) 18s ago 7m 7977k - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (74s) 13s ago 7m 15.2M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (11m) 18s ago 11m 55.1M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 18s ago 10m 55.9M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 18s ago 10m 48.4M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (9m) 18s ago 9m 52.3M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (9m) 13s ago 9m 53.2M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (9m) 13s ago 9m 52.5M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (8m) 13s ago 8m 49.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (8m) 13s ago 8m 51.5M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (37s) 13s ago 7m 46.6M - 2.43.0 a07b618ecd1d ca6526cb1879 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (5m) 18s ago 5m 71.3M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (5m) 13s ago 5m 73.8M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:21:34.146 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (5m) 18s ago 5m 71.9M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:21:34.147 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (5m) 13s ago 5m 71.6M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 op/s 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='client.25489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:34.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:34.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:34.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:34.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:34.577 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:21:34.578 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:21:34.938 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:21:34.938 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:21:34.938 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:21:34.938 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:21:34.938 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:21:34.939 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:21:34.939 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T23:21:34.939 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:21:34.939 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3544683173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3544683173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.161 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3544683173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.371 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-09-20T23:21:35.371 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-09-20T23:21:35.371 INFO:teuthology.orchestra.run.smithi170.stdout: daemon iscsi.foo.smithi170.ykmvuq on smithi170 is in unknown state 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2442150885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:35.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2442150885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.208 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:21:35] "GET /metrics HTTP/1.1" 200 38258 "" "Prometheus/2.43.0" 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.209 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2442150885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:21:36.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:36.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:36.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:36.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:36.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:36.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:21:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:38.605 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:38 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:38.605 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:38 smithi191 ceph-mon[24760]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:21:38.605 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:38 smithi191 ceph-mon[24760]: Cluster is now healthy 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[28691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[28691]: Cluster is now healthy 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[23733]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:21:38.614 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:38 smithi170 ceph-mon[23733]: Cluster is now healthy 2024-09-20T23:21:38.876 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:38.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:39.682 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.683 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:39.683 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:40.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:40 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.y 2024-09-20T23:21:40.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:40 smithi170 ceph-mon[23733]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:40.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:40 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.y 2024-09-20T23:21:40.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:40 smithi170 ceph-mon[28691]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:40 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.y 2024-09-20T23:21:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:40 smithi191 ceph-mon[24760]: Deploying daemon mgr.y on smithi170 2024-09-20T23:21:41.613 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:41 smithi170 ceph-mon[23733]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:21:41.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:41 smithi170 ceph-mon[28691]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:21:41.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:41 smithi191 ceph-mon[24760]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:21:42.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:42 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:43.096 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:42 smithi170 podman[77771]: 2024-09-20 23:21:42.808516477 +0000 UTC m=+0.128163136 container died 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:21:43.382 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 podman[77771]: 2024-09-20 23:21:43.19440218 +0000 UTC m=+0.514048831 container cleanup 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-20T23:21:43.382 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 bash[77771]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:21:43.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:43 smithi170 ceph-mon[23733]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 736 B/s rd, 0 op/s 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:43 smithi170 ceph-mon[28691]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 736 B/s rd, 0 op/s 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 podman[77784]: 2024-09-20 23:21:43.487591457 +0000 UTC m=+0.674952895 container remove 2a998a684d765a46a88e50816c76f8850a59481787269202a1cf1c2e67ee1e95 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 systemd[1]: Stopped Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:43.638 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 6.181s CPU time. 2024-09-20T23:21:43.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:43 smithi191 ceph-mon[24760]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 736 B/s rd, 0 op/s 2024-09-20T23:21:43.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:43.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:43 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:21:44.301 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 podman[77911]: 2024-09-20 23:21:43.942227172 +0000 UTC m=+0.016411314 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-09-20T23:21:44.301 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 podman[77911]: 2024-09-20 23:21:44.055774795 +0000 UTC m=+0.129958968 container create 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, RELEASE=HEAD, io.buildah.version=1.19.8, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., version=8, build-date=2022-05-03T08:36:31.336870, release=754, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , name=centos-stream) 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 podman[77911]: 2024-09-20 23:21:44.299859848 +0000 UTC m=+0.374043986 container init 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, ceph=True, io.openshift.expose-services=, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, name=centos-stream, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, version=8) 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 podman[77911]: 2024-09-20 23:21:44.302910012 +0000 UTC m=+0.377094142 container start 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, RELEASE=HEAD, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, ceph=True, io.buildah.version=1.19.8, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD) 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-mgr[77929]: -- 172.21.15.170:0/14214186 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5555630ae340 con 0x555563087000 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 bash[77911]: 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:44.448+0000 7f1c0712a000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:44.534+0000 7f1c0712a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:44.722 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:44.719+0000 7f1c0712a000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:21:44.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:44.811+0000 7f1c0712a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:21:44.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:44.944+0000 7f1c0712a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:45.384 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:45.174+0000 7f1c0712a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:21:45.646 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:45.530+0000 7f1c0712a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:45.630+0000 7f1c0712a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:45.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:45.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:45.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:45.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:45.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:45 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:45.807+0000 7f1c0712a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:21:46.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:21:45] "GET /metrics HTTP/1.1" 200 38254 "" "Prometheus/2.43.0" 2024-09-20T23:21:46.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.504 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.505 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.506 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:46 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.610 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.610 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.610 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.613 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.615 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.617 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:46.618 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:46 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:46.961+0000 7f1c0712a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:21:47.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:47.056+0000 7f1c0712a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.730 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.736 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:47.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.387 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.084+0000 7f1c0712a000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:21:48.641 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.424+0000 7f1c0712a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:21:48.641 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.566+0000 7f1c0712a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:21:48.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:48.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:48.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:48.898 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.663+0000 7f1c0712a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:21:48.898 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.775+0000 7f1c0712a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:21:48.898 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:48.870+0000 7f1c0712a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:21:48.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:48.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:49.242 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.034+0000 7f1c0712a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:21:49.242 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.137+0000 7f1c0712a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:21:49.242 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.239+0000 7f1c0712a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:21:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:49.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:49 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:49.804 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.542+0000 7f1c0712a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:21:49.804 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.638+0000 7f1c0712a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:21:49.804 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:49.734+0000 7f1c0712a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:50.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:50.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:50.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:50 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:50.984+0000 7f1c0712a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:50 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: [20/Sep/2024:23:21:50] ENGINE Bus STARTING 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: CherryPy Checker: 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: The Application mounted at '' has an empty config. 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: [20/Sep/2024:23:21:51] ENGINE Serving on http://:::9283 2024-09-20T23:21:51.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[77925]: [20/Sep/2024:23:21:51] ENGINE Bus STARTED 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:51.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:51 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.735 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:21:51.738 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.739 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:51 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: mgrmap e40: x(active, since 45s), standbys: y 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:52 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: mgrmap e40: x(active, since 45s), standbys: y 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: mgrmap e40: x(active, since 45s), standbys: y 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:52.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:52.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:52.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:52.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:52.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:52 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.631 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:53 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:53.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:54 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:54.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:54.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:54.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:54.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:54.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:54 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.632 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:55 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:55.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:55.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:55.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:55.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.165 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:21:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:21:55] "GET /metrics HTTP/1.1" 200 38251 "" "Prometheus/2.43.0" 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:56 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:56.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:56 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.586 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.588 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.591 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.592 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.593 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:57 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:57.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:57 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:58.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:58 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:58.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:21:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:21:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:21:59 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:21:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:21:59 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:00.926 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.y 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:00.930 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[23733]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.y 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:00.931 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:00 smithi170 ceph-mon[28691]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:00.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.y 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:00 smithi191 ceph-mon[24760]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:02.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:02 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:03.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:03 smithi170 ceph-mon[23733]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:03.489 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 podman[83365]: 2024-09-20 23:22:03.193531582 +0000 UTC m=+0.132378015 container died 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., io.buildah.version=1.19.8, architecture=x86_64, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-09-20T23:22:03.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:03 smithi170 ceph-mon[28691]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:03 smithi191 ceph-mon[24760]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:03.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:03.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 podman[83365]: 2024-09-20 23:22:03.570532318 +0000 UTC m=+0.509378750 container cleanup 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, io.openshift.expose-services=, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, release=754, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, distribution-scope=public, maintainer=Guillaume Abrioux ) 2024-09-20T23:22:03.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 bash[83365]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:22:04.200 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 podman[83377]: 2024-09-20 23:22:03.847275078 +0000 UTC m=+0.654080699 container remove 8a59b32a70eca8e3e9d4e6637b676ad1294e380e6874a4cf4aaad7de9dbde217 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, ceph=True, RELEASE=HEAD, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, version=8, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, architecture=x86_64, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-20T23:22:04.200 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:22:04.200 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-20T23:22:04.200 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 systemd[1]: Stopped Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:04.200 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:03 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 8.075s CPU time. 2024-09-20T23:22:04.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:04.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 podman[83508]: 2024-09-20 23:22:04.318421239 +0000 UTC m=+0.015695952 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:22:04.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 podman[83508]: 2024-09-20 23:22:04.515005645 +0000 UTC m=+0.212280338 container create 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:22:04.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 podman[83508]: 2024-09-20 23:22:04.725923864 +0000 UTC m=+0.423198568 container init 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-20T23:22:04.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 podman[83508]: 2024-09-20 23:22:04.728804616 +0000 UTC m=+0.426079305 container start 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux ) 2024-09-20T23:22:04.810 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 ceph-mgr[83527]: -- 172.21.15.170:0/1564669223 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56460edab0e0 con 0x56460ed88800 2024-09-20T23:22:05.061 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 bash[83508]: 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf 2024-09-20T23:22:05.061 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:05.061 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:04.854+0000 7f5e4f41e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:22:05.061 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:04 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:04.917+0000 7f5e4f41e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:05.315 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.080+0000 7f5e4f41e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:22:05.315 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.150+0000 7f5e4f41e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:22:05.315 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.313+0000 7f5e4f41e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.472+0000 7f5e4f41e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:05.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:05.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:05.788 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:22:06.059 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.843+0000 7f5e4f41e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:22:06.059 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:05.917+0000 7f5e4f41e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:22:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:22:05] "GET /metrics HTTP/1.1" 200 38251 "" "Prometheus/2.43.0" 2024-09-20T23:22:06.391 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:06.122+0000 7f5e4f41e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:22:06.505 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:22:06.505 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 7s ago 12m - - 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 9s ago 12m - - 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (2m) 7s ago 7m 26.5M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (99s) 9s ago 7m 45.5M - dad864ee21e9 db20e8680365 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (50s) 7s ago 5m 46.3M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (65s) 9s ago 12m 503M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 starting - - - - 2024-09-20T23:22:06.506 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (13m) 7s ago 13m 73.4M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:22:06.507 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (12m) 9s ago 12m 52.9M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:22:06.507 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (12m) 7s ago 12m 52.0M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:22:06.507 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (2m) 7s ago 8m 16.5M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:22:06.507 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (106s) 9s ago 8m 15.9M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:22:06.507 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (11m) 7s ago 11m 55.4M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (11m) 7s ago 11m 56.4M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 7s ago 10m 49.1M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (10m) 7s ago 10m 53.0M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (10m) 9s ago 10m 53.7M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (9m) 9s ago 9m 53.3M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (9m) 9s ago 9m 50.0M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:22:06.508 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (8m) 9s ago 8m 52.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:22:06.509 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (48s) 9s ago 8m 55.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:22:06.509 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (6m) 7s ago 6m 71.5M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:22:06.509 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (6m) 9s ago 6m 74.1M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:22:06.509 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (6m) 7s ago 6m 72.3M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:22:06.509 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (6m) 9s ago 6m 71.8M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.725 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.726 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.727 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.728 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:06 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:06.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:06.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:06.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:06 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:22:06.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:22:06.932 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:22:07.295 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:22:07.296 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:22:07.296 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:07.117+0000 7f5e4f41e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:22:07.296 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:07.193+0000 7f5e4f41e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:22:07.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='client.25537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='client.25537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2391796908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2391796908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.409 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:07 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='client.25537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2391796908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:07.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:07 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:07.754 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:22:08.308 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.001+0000 7f5e4f41e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:22:08.309 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.128+0000 7f5e4f41e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:22:08.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.311+0000 7f5e4f41e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:08.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.376+0000 7f5e4f41e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:22:08.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.539+0000 7f5e4f41e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:22:08.613 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.611+0000 7f5e4f41e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.614 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='client.25561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.615 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.616 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='client.25561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.617 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.618 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/2876451728' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.619 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.621 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/2876451728' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='client.25561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2876451728' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:08.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:08.929 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.677+0000 7f5e4f41e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:22:08.929 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.848+0000 7f5e4f41e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:22:08.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:09.233 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:08.927+0000 7f5e4f41e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:22:09.233 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:09.000+0000 7f5e4f41e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:22:09.233 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:09.092+0000 7f5e4f41e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:09.234 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:09.160+0000 7f5e4f41e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:22:09.234 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:09.231+0000 7f5e4f41e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:22:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:09 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:09.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:09.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:09 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.343 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:10.110+0000 7f5e4f41e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: [20/Sep/2024:23:22:10] ENGINE Bus STARTING 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: CherryPy Checker: 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: The Application mounted at '' has an empty config. 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: [20/Sep/2024:23:22:10] ENGINE Serving on http://:::9283 2024-09-20T23:22:10.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[83523]: [20/Sep/2024:23:22:10] ENGINE Bus STARTED 2024-09-20T23:22:10.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.662 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:10.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.665 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.666 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.667 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:10 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/132948029' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:10.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:10 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: mgrmap e41: x(active, since 64s), standbys: y 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:11 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:11.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: mgrmap e41: x(active, since 64s), standbys: y 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: mgrmap e41: x(active, since 64s), standbys: y 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:11.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:11.754 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:11.754 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:11 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:12 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-367-g9e2ac70b 2024-09-20T23:22:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:12.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:12.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:12.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:12 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.524 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.529 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:13 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:13 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:14 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.562 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.563 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:14.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:14 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.630 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:15.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.677 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:15.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:15 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.194 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:22:15] "GET /metrics HTTP/1.1" 200 38250 "" "Prometheus/2.43.0" 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:16 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.678 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.679 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:16.683 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:16 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:17 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.557 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.560 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.561 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.562 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:17.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:17 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:18.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:18 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:18.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:18.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:19.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.634 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.635 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:19 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:19 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:20 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:20 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:21 smithi170 ceph-mon[23733]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:21.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:21 smithi170 ceph-mon[28691]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:21 smithi191 ceph-mon[24760]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: Upgrade: Updating mgr.y 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:22.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[23733]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: Upgrade: Updating mgr.y 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:22.960 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:22 smithi170 ceph-mon[28691]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:22.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: Upgrade: Updating mgr.y 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: Deploying daemon mgr.y on smithi170 2024-09-20T23:22:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:22 smithi191 ceph-mon[24760]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:23.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:23.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:25.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:25 smithi170 ceph-mon[23733]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:25.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:25 smithi170 ceph-mon[28691]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:25.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:25 smithi191 ceph-mon[24760]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:25.743 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:25 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:26.069 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:25 smithi170 podman[89241]: 2024-09-20 23:22:25.789242681 +0000 UTC m=+0.154708029 container died 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70) 2024-09-20T23:22:26.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:22:25] "GET /metrics HTTP/1.1" 200 38249 "" "Prometheus/2.43.0" 2024-09-20T23:22:26.427 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 podman[89241]: 2024-09-20 23:22:26.174934362 +0000 UTC m=+0.540399706 container cleanup 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70) 2024-09-20T23:22:26.427 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 bash[89241]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:22:26.714 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 podman[89253]: 2024-09-20 23:22:26.426062407 +0000 UTC m=+0.632427170 container remove 9f41d6ecace6dc72c7ee4d3f765d9e5f53579282246e0bdfb80b6074698b51cf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-20T23:22:26.714 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:22:26.715 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-20T23:22:26.715 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 systemd[1]: Stopped Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:26.715 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 6.300s CPU time. 2024-09-20T23:22:26.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:26 smithi170 systemd[1]: Starting Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:27.283 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 podman[89380]: 2024-09-20 23:22:26.930727526 +0000 UTC m=+0.017200204 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:22:27.283 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 podman[89380]: 2024-09-20 23:22:27.052407867 +0000 UTC m=+0.138880538 container create 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T23:22:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-mon[23733]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-mon[28691]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 podman[89380]: 2024-09-20 23:22:27.31810929 +0000 UTC m=+0.404581959 container init 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 podman[89380]: 2024-09-20 23:22:27.321377696 +0000 UTC m=+0.407850373 container start 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-mgr[89398]: -- 172.21.15.170:0/93893431 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561cfe9970e0 con 0x561cfe975000 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 bash[89380]: 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 systemd[1]: Started Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:27.625 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:27.445+0000 7fc96d648040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:22:27.626 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:27.515+0000 7fc96d648040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:27.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:27 smithi191 ceph-mon[24760]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:27.902 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:27.681+0000 7fc96d648040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:22:27.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:27.751+0000 7fc96d648040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:22:28.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:27.909+0000 7fc96d648040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:28.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:28.060+0000 7fc96d648040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.707 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:28.419+0000 7fc96d648040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:22:28.707 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:28.494+0000 7fc96d648040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:22:28.707 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:28.705+0000 7fc96d648040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:22:28.707 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:28.707 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-20T23:22:28.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:28.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:28.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:28.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:28.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:28 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:28.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:29.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.537 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.538 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.539 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.541 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.542 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.543 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:29.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:29.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:29 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:29.912 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:29.668+0000 7fc96d648040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:22:29.912 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:29.744+0000 7fc96d648040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:22:30.652 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:30.521+0000 7fc96d648040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:22:30.652 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:30.649+0000 7fc96d648040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.660 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.661 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:30.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:30 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:30.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:30.801+0000 7fc96d648040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:30.993 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:30 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:30.869+0000 7fc96d648040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:22:31.342 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.027+0000 7fc96d648040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:22:31.343 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.107+0000 7fc96d648040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:22:31.343 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.171+0000 7fc96d648040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:22:31.343 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.339+0000 7fc96d648040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:22:31.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.409+0000 7fc96d648040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:22:31.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.482+0000 7fc96d648040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:22:31.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.570+0000 7fc96d648040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:31.635 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.632+0000 7fc96d648040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:31.636 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:31.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:31 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:31.909 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:31.708+0000 7fc96d648040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:22:32.565 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.566 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.567 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.568 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.569 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.570 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.571 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.572 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.573 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.574 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.574 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:32.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:32 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:32.602+0000 7fc96d648040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:32] ENGINE Bus STARTING 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: CherryPy Checker: 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: The Application mounted at '' has an empty config. 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:32] ENGINE Serving on http://:::9283 2024-09-20T23:22:32.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:32] ENGINE Bus STARTED 2024-09-20T23:22:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Standby manager daemon y restarted 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: Standby manager daemon y started 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:33.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:33 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/1973636363' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:33.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:33.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:33.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:33 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.663 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: mgrmap e42: x(active, since 87s), standbys: y 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.664 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.665 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.666 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.667 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:34 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: mgrmap e42: x(active, since 87s), standbys: y 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: mgrmap e42: x(active, since 87s), standbys: y 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:34 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:35.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:35 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.199 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:22:35] "GET /metrics HTTP/1.1" 200 38249 "" "Prometheus/2.43.0" 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:36 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.708 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.709 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.713 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.714 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:36.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:36 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:37 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:37.724 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:37 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.125 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:22:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.668 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.669 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:38 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:38.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:38.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:38.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:38.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:38.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:38 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:38.818 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:22:38.818 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 17s ago 13m - - 2024-09-20T23:22:38.818 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 1s ago 13m - - 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (2m) 17s ago 8m 27.4M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (2m) 1s ago 7m 47.2M - dad864ee21e9 db20e8680365 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (82s) 17s ago 6m 46.6M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (97s) 1s ago 12m 508M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 starting - - - - 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (14m) 17s ago 14m 73.3M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (12m) 1s ago 12m 59.9M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (13m) 17s ago 13m 55.9M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (2m) 17s ago 8m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (2m) 1s ago 8m 15.4M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (12m) 17s ago 12m 55.5M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (11m) 17s ago 11m 56.4M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:22:38.819 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (11m) 17s ago 11m 49.4M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (11m) 17s ago 11m 53.1M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (10m) 1s ago 10m 54.2M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (10m) 1s ago 10m 53.8M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (9m) 1s ago 9m 50.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (9m) 1s ago 9m 52.5M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (80s) 1s ago 8m 56.1M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (6m) 17s ago 6m 71.6M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (6m) 1s ago 6m 74.2M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (6m) 17s ago 6m 72.5M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:22:38.820 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (6m) 1s ago 6m 72.2M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:22:39.262 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:22:39.262 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:22:39.262 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:39.263 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:22:39.264 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='client.15684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.620 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='client.25585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='client.15684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.622 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='client.25585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.624 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/3395719561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/3395719561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:39 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.669 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:22:39.669 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:22:39.669 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:22:39.669 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:22:39.669 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-20T23:22:39.670 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "", 2024-09-20T23:22:39.670 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T23:22:39.670 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:22:39.670 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='client.15684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='client.25585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3395719561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:39 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.125 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:22:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='client.? 172.21.15.170:0/1337343354' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/1337343354' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:40 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1337343354' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:40 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='client.15708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:41 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='client.15708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='client.15708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:41.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:41.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:41 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.685 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:42.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.688 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:42 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:42 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[23733]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[23733]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[23733]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[28691]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:22:43.691 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:43 smithi170 ceph-mon[28691]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:43.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:22:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:43 smithi191 ceph-mon[24760]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:22:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:43 smithi191 ceph-mon[24760]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:43.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:45.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:45 smithi170 ceph-mon[23733]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:45.625 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:45 smithi170 ceph-mon[28691]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:45.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:45 smithi191 ceph-mon[24760]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:46.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:22:45] "GET /metrics HTTP/1.1" 200 38250 "" "Prometheus/2.43.0" 2024-09-20T23:22:47.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: Upgrade: Updating mon.a 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: Deploying daemon mon.a on smithi170 2024-09-20T23:22:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:47 smithi191 ceph-mon[24760]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: Upgrade: Updating mon.a 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: Deploying daemon mon.a on smithi170 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[28691]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: Upgrade: Updating mon.a 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: from='mgr.35117 ' entity='mgr.x' 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: Deploying daemon mon.a on smithi170 2024-09-20T23:22:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:47 smithi170 ceph-mon[23733]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:48.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:48 smithi170 ceph-mon[23733]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:48.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:48 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:48.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:48 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:22:48.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:49.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:49 smithi170 ceph-mon[23733]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:49.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:49 smithi170 ceph-mon[28691]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:49.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:49 smithi191 ceph-mon[24760]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:22:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:49 smithi170 systemd[1]: Stopping Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[23728]: 2024-09-20T23:22:49.862+0000 7fda2a658700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:22:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[23728]: 2024-09-20T23:22:49.862+0000 7fda2a658700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-20T23:22:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 podman[95300]: 2024-09-20 23:22:50.107756802 +0000 UTC m=+0.344001508 container died 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, name=centos-stream, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8) 2024-09-20T23:22:50.831 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 podman[95300]: 2024-09-20 23:22:50.570571188 +0000 UTC m=+0.806815891 container cleanup 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, vcs-type=git, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, version=8, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-09-20T23:22:50.831 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 bash[95300]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a 2024-09-20T23:22:51.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 podman[95315]: 2024-09-20 23:22:50.830242055 +0000 UTC m=+0.713132313 container remove 9da22590452d057ea62afc9b3d8dcbc471ab260d46a74b4b7f4bf72251f22628 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=-17.2.0, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., RELEASE=HEAD, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, name=centos-stream, ceph=True, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8) 2024-09-20T23:22:51.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-20T23:22:51.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 systemd[1]: Stopped Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:51.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:50 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Consumed 19.859s CPU time. 2024-09-20T23:22:51.420 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 systemd[1]: Starting Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:22:51.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 podman[95441]: 2024-09-20 23:22:51.321447913 +0000 UTC m=+0.016305192 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:22:51.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 podman[95441]: 2024-09-20 23:22:51.423012274 +0000 UTC m=+0.117869550 container create e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-20T23:22:51.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 podman[95441]: 2024-09-20 23:22:51.667425501 +0000 UTC m=+0.362282776 container init e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:22:51.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 podman[95441]: 2024-09-20 23:22:51.670609766 +0000 UTC m=+0.365467040 container start e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-20T23:22:51.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:22:51.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:22:51.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: pidfile_write: ignore empty --pid-file 2024-09-20T23:22:51.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: load: jerasure load: lrc 2024-09-20T23:22:51.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Git sha 0 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: DB SUMMARY 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: DB Session ID: M46M5MXBJNXX8KKE2QXW 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: MANIFEST file: MANIFEST-000015 size: 2133 Bytes 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000048.sst 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000046.log size: 1212764 ; 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:22:51.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.env: 0x5623610aa940 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.info_log: 0x5623624d96e0 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.statistics: (nil) 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.use_fsync: 0 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:22:51.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.db_log_dir: 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.wal_dir: 2024-09-20T23:22:51.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:22:51.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:22:51.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:22:51.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:22:51.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:22:51.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.write_buffer_manager: 0x5623624e88c0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.unordered_write: 0 2024-09-20T23:22:51.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.row_cache: None 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.wal_filter: None 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.wal_compression: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:22:51.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:22:52.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_open_files: -1 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Compression algorithms supported: 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kZSTD supported: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:22:52.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.merge_operator: 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_filter: None 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:22:52.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5623624d9320) 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_type: 0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_shortening: 1 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: checksum: 4 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: no_block_cache: 0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache: 0x5623624cd1f0 2024-09-20T23:22:52.003 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_options: 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: capacity : 536870912 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size: 4096 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: partition_filters: 0 2024-09-20T23:22:52.004 INFO:journalctl@ceph.mon.a.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: filter_policy: bloomfilter 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: verify_compression: 0 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: format_version: 5 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_align: 0 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: prepopulate_block_cache: 0 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression: NoCompression 2024-09-20T23:22:52.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.num_levels: 7 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:22:52.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:22:52.007 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:22:52.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:22:52.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.ttl: 2592000 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:22:52.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 48.sst 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 50, last_sequence is 24431, log_number is 46,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 46 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 14c53d63-47d9-433c-860a-bf61c8779653 2024-09-20T23:22:52.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874571697826, "job": 1, "event": "recovery_started", "wal_files": [46]} 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #46 mode 2 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874571702810, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 51, "file_size": 1173325, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 24432, "largest_seqno": 25895, "table_properties": {"data_size": 1167688, "index_size": 2420, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 21145, "raw_average_key_size": 24, "raw_value_size": 1153318, "raw_average_value_size": 1336, "num_data_blocks": 99, "num_entries": 863, "num_filter_entries": 863, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726874571, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "14c53d63-47d9-433c-860a-bf61c8779653", "db_session_id": "M46M5MXBJNXX8KKE2QXW", "orig_file_number": 51, "seqno_to_time_mapping": "N/A"}} 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874571702924, "job": 1, "event": "recovery_finished"} 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:5047] Creating manifest 53 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000046.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5623624fae00 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: DB pointer 0x5623625f6000 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** DB Stats ** 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:22:52.012 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: L0 1/0 1.12 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 406.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: L6 1/0 9.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Sum 2/0 10.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 406.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:22:52.013 INFO:journalctl@ceph.mon.a.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 406.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 406.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:22:52.014 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative compaction: 0.00 GB write, 152.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval compaction: 0.00 GB write, 152.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache BinnedLRUCache@0x5623624cd1f0#2 capacity: 512.00 MB usage: 4.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: starting mon.a rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???) e3 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).mds e1 new map 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).mds e1 print_map 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: e1 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:22:52.015 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout: No filesystems configured 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:22:52.016 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:22:52.074 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:22:52.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 ceph-mon[95460]: mon.a@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-09-20T23:22:52.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 bash[95441]: e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe 2024-09-20T23:22:52.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:51 smithi170 systemd[1]: Started Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:22:53.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ignoring --setuser ceph since I am not root 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ignoring --setgroup ceph since I am not root 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mgr[58991]: -- 172.21.15.191:0/1327836396 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560fa9bdb0e0 con 0x560fa9bb9000 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.295+0000 7f1880f70040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.352+0000 7f1880f70040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: mon.a calling monitor election 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:22:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: monmap epoch 3 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: min_mon_release 17 (quincy) 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: election_strategy: 1 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: fsmap 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: mgrmap e42: x(active, since 106s), standbys: y 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: from='mgr.35117 ' entity='' 2024-09-20T23:22:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-mon[24760]: mgrmap e43: x(active, since 106s), standbys: y 2024-09-20T23:22:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: ignoring --setuser ceph since I am not root 2024-09-20T23:22:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: ignoring --setgroup ceph since I am not root 2024-09-20T23:22:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mgr[89398]: -- 172.21.15.170:0/3942585296 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5a43650e0 con 0x55a5a4342800 2024-09-20T23:22:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.291+0000 7f283c5a9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T23:22:53.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.348+0000 7f283c5a9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: mon.a calling monitor election 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: monmap epoch 3 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: min_mon_release 17 (quincy) 2024-09-20T23:22:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: election_strategy: 1 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: fsmap 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: mgrmap e42: x(active, since 106s), standbys: y 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: overall HEALTH_OK 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: from='mgr.35117 ' entity='' 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[95460]: mgrmap e43: x(active, since 106s), standbys: y 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: from='mgr.35117 172.21.15.191:0/185466394' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:53.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: mon.a calling monitor election 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: monmap epoch 3 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: min_mon_release 17 (quincy) 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: election_strategy: 1 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: fsmap 2024-09-20T23:22:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: osdmap e114: 8 total, 8 up, 8 in 2024-09-20T23:22:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: mgrmap e42: x(active, since 106s), standbys: y 2024-09-20T23:22:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:22:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: from='mgr.35117 ' entity='' 2024-09-20T23:22:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-mon[28691]: mgrmap e43: x(active, since 106s), standbys: y 2024-09-20T23:22:53.853 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.497+0000 7f283c5a9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:22:53.853 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.564+0000 7f283c5a9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:22:53.853 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.709+0000 7f283c5a9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:53.853 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:53 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:53.851+0000 7f283c5a9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:22:53.855 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:22:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:22:53.855 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.501+0000 7f1880f70040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T23:22:53.856 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.568+0000 7f1880f70040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T23:22:53.856 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.713+0000 7f1880f70040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:53.856 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:53.853+0000 7f1880f70040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T23:22:54.476 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:54 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:54.168+0000 7f1880f70040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:22:54.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:54 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:54.228+0000 7f1880f70040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:22:54.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:54 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:54.413+0000 7f1880f70040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:22:54.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:54.168+0000 7f283c5a9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T23:22:54.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:54.228+0000 7f283c5a9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T23:22:54.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:54.411+0000 7f283c5a9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T23:22:55.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:55 smithi191 ceph-mon[24760]: mgrmap e44: x(active, since 107s), standbys: y 2024-09-20T23:22:55.400 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:55.329+0000 7f1880f70040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:22:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:55 smithi170 ceph-mon[95460]: mgrmap e44: x(active, since 107s), standbys: y 2024-09-20T23:22:55.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:55.301+0000 7f283c5a9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T23:22:55.493 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:55 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:55.368+0000 7f283c5a9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:22:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:55 smithi170 ceph-mon[28691]: mgrmap e44: x(active, since 107s), standbys: y 2024-09-20T23:22:55.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:55.398+0000 7f1880f70040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T23:22:56.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.081+0000 7f283c5a9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:22:56.344 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.201+0000 7f283c5a9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:22:56.413 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.157+0000 7f1880f70040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T23:22:56.414 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.280+0000 7f1880f70040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T23:22:56.620 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.342+0000 7f283c5a9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:56.620 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.403+0000 7f283c5a9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:22:56.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.551+0000 7f283c5a9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:22:56.621 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.618+0000 7f283c5a9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:22:56.719 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.429+0000 7f1880f70040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T23:22:56.720 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.491+0000 7f1880f70040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T23:22:56.720 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.647+0000 7f1880f70040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T23:22:56.720 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.717+0000 7f1880f70040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T23:22:56.902 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.678+0000 7f283c5a9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:22:56.903 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.836+0000 7f283c5a9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:22:56.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.780+0000 7f1880f70040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T23:22:56.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:56 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:56.948+0000 7f1880f70040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T23:22:57.168 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.900+0000 7f283c5a9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:22:57.169 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:56 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:56.967+0000 7f283c5a9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:22:57.169 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:57.048+0000 7f283c5a9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:57.169 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:57.107+0000 7f283c5a9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:22:57.169 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:57.166+0000 7f283c5a9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:22:57.296 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:57.016+0000 7f1880f70040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T23:22:57.296 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:57.086+0000 7f1880f70040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T23:22:57.296 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:57.174+0000 7f1880f70040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T23:22:57.296 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:57.234+0000 7f1880f70040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T23:22:57.296 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:57.294+0000 7f1880f70040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T23:22:58.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:57.975+0000 7f283c5a9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:22:58.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:57] ENGINE Bus STARTING 2024-09-20T23:22:58.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: CherryPy Checker: 2024-09-20T23:22:58.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: The Application mounted at '' has an empty config. 2024-09-20T23:22:58.243 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:58] ENGINE Serving on http://:::9283 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y[89394]: [20/Sep/2024:23:22:58] ENGINE Bus STARTED 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: Standby manager daemon y restarted 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: Standby manager daemon y started 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[95460]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:58.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: Standby manager daemon y restarted 2024-09-20T23:22:58.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: Standby manager daemon y started 2024-09-20T23:22:58.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:58.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:58.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:58.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:58 smithi170 ceph-mon[28691]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: Standby manager daemon y restarted 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: Standby manager daemon y started 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-mon[24760]: from='mgr.? 172.21.15.170:0/3384956481' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T23:22:58.351 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:58.119+0000 7f1880f70040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:22:58] ENGINE Bus STARTING 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: CherryPy Checker: 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: The Application mounted at '' has an empty config. 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:22:58] ENGINE Serving on http://:::9283 2024-09-20T23:22:58.352 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:22:58] ENGINE Bus STARTED 2024-09-20T23:22:59.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:59.144+0000 7f181fc79640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-20T23:22:59.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: mgrmap e45: x(active, since 111s), standbys: y 2024-09-20T23:22:59.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: Active manager daemon x restarted 2024-09-20T23:22:59.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: Activating manager daemon x 2024-09-20T23:22:59.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:22:59.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: mgrmap e46: x(active, starting, since 0.00738724s), standbys: y 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:22:59.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: Manager daemon x is now available 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:59.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: mgrmap e45: x(active, since 111s), standbys: y 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: Active manager daemon x restarted 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: Activating manager daemon x 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: mgrmap e46: x(active, starting, since 0.00738724s), standbys: y 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:22:59.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: Manager daemon x is now available 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:22:59.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: mgrmap e45: x(active, since 111s), standbys: y 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: Active manager daemon x restarted 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: Activating manager daemon x 2024-09-20T23:22:59.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: mgrmap e46: x(active, starting, since 0.00738724s), standbys: y 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:22:59.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: Manager daemon x is now available 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi191", "caps": []}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:22:59.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:22:59.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:22:59 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:22:59.666+0000 7f17dc76b640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:23:22:59] ENGINE Error in HTTPServer.serve 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: Traceback (most recent call last): 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._connections.run(self.expiration_interval) 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._run(expiration_interval) 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:22:59.857 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: s = self.context.wrap_socket( 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: return self.sslsocket_class._create( 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self.do_handshake() 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: self._sslobj.do_handshake() 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:22:59.858 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:22:59 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:23:00.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: mgrmap e47: x(active, since 1.00855s), standbys: y 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: mgrmap e47: x(active, since 1.00855s), standbys: y 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:00 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: mgrmap e47: x(active, since 1.00855s), standbys: y 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:00 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: [20/Sep/2024:23:22:59] ENGINE Bus STARTING 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: [20/Sep/2024:23:22:59] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: [20/Sep/2024:23:22:59] ENGINE Error in HTTPServer.serve 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout: Traceback (most recent call last): 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:23:01.300 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._run(expiration_interval) 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: s = self.context.wrap_socket( 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: return self.sslsocket_class._create( 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: self.do_handshake() 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: self._sslobj.do_handshake() 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: [20/Sep/2024:23:22:59] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: [20/Sep/2024:23:22:59] ENGINE Bus STARTED 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: mgrmap e48: x(active, since 2s), standbys: y 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:01 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: [20/Sep/2024:23:22:59] ENGINE Bus STARTING 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: [20/Sep/2024:23:22:59] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: [20/Sep/2024:23:22:59] ENGINE Error in HTTPServer.serve 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:23:01.365 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: self.do_handshake() 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: [20/Sep/2024:23:22:59] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: [20/Sep/2024:23:22:59] ENGINE Bus STARTED 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: [20/Sep/2024:23:22:59] ENGINE Bus STARTING 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: [20/Sep/2024:23:22:59] ENGINE Serving on https://172.21.15.191:7150 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: [20/Sep/2024:23:22:59] ENGINE Error in HTTPServer.serve 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: Traceback (most recent call last): 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._run(expiration_interval) 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T23:23:01.368 INFO:journalctl@ceph.mon.c.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: s = self.context.wrap_socket( 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: return self.sslsocket_class._create( 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: self.do_handshake() 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: self._sslobj.do_handshake() 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: [20/Sep/2024:23:22:59] ENGINE Serving on http://172.21.15.191:8765 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: [20/Sep/2024:23:22:59] ENGINE Bus STARTED 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Updating smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T23:23:01.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi170", "caps": []}]: dispatch 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.370 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: mgrmap e48: x(active, since 2s), standbys: y 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.372 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: mgrmap e48: x(active, since 2s), standbys: y 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:01.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:01 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:02 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.374 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:03.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[95460]: mgrmap e49: x(active, since 5s), standbys: y 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:03 smithi170 ceph-mon[28691]: mgrmap e49: x(active, since 5s), standbys: y 2024-09-20T23:23:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:03.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:03.484 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:03.484 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-mon[24760]: mgrmap e49: x(active, since 5s), standbys: y 2024-09-20T23:23:03.879 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.241 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:04 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.438 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.439 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:04.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.288 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.290 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.291 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.292 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:05.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:05 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:05.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-20T23:23:06.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:05] "GET /metrics HTTP/1.1" 200 35472 "" "Prometheus/2.43.0" 2024-09-20T23:23:06.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: Upgrade: It appears safe to stop mon.a 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:06.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:06 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:07.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:07 smithi170 ceph-mon[95460]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:23:07.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:07 smithi170 ceph-mon[28691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:23:07.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:07 smithi191 ceph-mon[24760]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-20T23:23:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:08.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:08.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[95460]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:08 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:08.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[95460]: Upgrade: Updating mon.a 2024-09-20T23:23:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[95460]: Deploying daemon mon.a on smithi170 2024-09-20T23:23:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[95460]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:23:09.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[28691]: Upgrade: Updating mon.a 2024-09-20T23:23:09.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[28691]: Deploying daemon mon.a on smithi170 2024-09-20T23:23:09.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:09 smithi170 ceph-mon[28691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:23:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:09 smithi191 ceph-mon[24760]: Upgrade: Updating mon.a 2024-09-20T23:23:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:09 smithi191 ceph-mon[24760]: Deploying daemon mon.a on smithi170 2024-09-20T23:23:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:09 smithi191 ceph-mon[24760]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[95460]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.361 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:10 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:10 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:10.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:10.489 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:23:11.161 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:23:11.161 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 1s ago 13m - - 2024-09-20T23:23:11.161 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 5s ago 13m - - 2024-09-20T23:23:11.161 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (3m) 1s ago 8m 27.4M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (2m) 5s ago 8m 52.6M - dad864ee21e9 db20e8680365 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (114s) 1s ago 6m 46.8M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (2m) 5s ago 13m 489M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (44s) 1s ago 14m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (14m) 1s ago 14m 76.0M 2048M 17.2.0 e1d6a67b021e 9da22590452d 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (13m) 5s ago 13m 65.3M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (13m) 1s ago 13m 57.4M 2048M 17.2.0 e1d6a67b021e 85fb1d400a6a 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (3m) 1s ago 9m 16.0M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (2m) 5s ago 9m 15.6M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (12m) 1s ago 12m 55.6M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (12m) 1s ago 12m 56.5M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:23:11.162 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (12m) 1s ago 11m 49.3M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (11m) 1s ago 11m 53.1M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (11m) 5s ago 11m 54.5M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (10m) 5s ago 10m 54.2M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (10m) 5s ago 10m 50.8M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (9m) 5s ago 9m 52.9M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (112s) 5s ago 9m 56.2M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (7m) 1s ago 7m 71.8M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (7m) 5s ago 7m 74.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (7m) 1s ago 7m 72.6M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:23:11.163 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (7m) 5s ago 7m 72.4M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:23:11.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:11 smithi191 ceph-mon[24760]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:23:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:11 smithi170 ceph-mon[95460]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:23:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:11 smithi170 ceph-mon[28691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-09-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:23:11.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": {}, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:23:11.576 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:23:11.913 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:23:11.914 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:23:11.914 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/23 daemons upgraded", 2024-09-20T23:23:11.914 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T23:23:11.914 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:23:11.914 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:23:12.321 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:23:12.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[95460]: from='client.44133 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[95460]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[95460]: from='client.25657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[95460]: from='client.? 172.21.15.170:0/774630816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[28691]: from='client.44133 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[28691]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[28691]: from='client.25657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.427 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:12 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/774630816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:12.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:12 smithi191 ceph-mon[24760]: from='client.44133 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:12 smithi191 ceph-mon[24760]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:12 smithi191 ceph-mon[24760]: from='client.25657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:12 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/774630816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:13.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 systemd[1]: Stopping Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:23:13.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: from='client.? 172.21.15.170:0/211927275' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[95460]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: from='client.? 172.21.15.170:0/211927275' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/211927275' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:13.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[95456]: 2024-09-20T23:23:13.425+0000 7fcefee12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:23:13.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[95456]: 2024-09-20T23:23:13.425+0000 7fcefee12640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-20T23:23:13.962 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:13 smithi170 podman[99105]: 2024-09-20 23:23:13.682340265 +0000 UTC m=+0.443702464 container died e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:23:13.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:14.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 podman[99105]: 2024-09-20 23:23:14.143741452 +0000 UTC m=+0.905103651 container cleanup e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-20T23:23:14.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 bash[99105]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a 2024-09-20T23:23:14.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 podman[99133]: 2024-09-20 23:23:14.461875498 +0000 UTC m=+0.774134009 container remove e413dd34aa3bf9ce0d2a4dabf976dcb9c1bfb9ee03eb0dbca701852bd5d99bbe (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-20T23:23:14.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-20T23:23:14.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 systemd[1]: Stopped Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:23:14.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service: Consumed 1.545s CPU time. 2024-09-20T23:23:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:14 smithi170 systemd[1]: Starting Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:23:15.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 podman[99262]: 2024-09-20 23:23:15.03768167 +0000 UTC m=+0.112319523 container create 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T23:23:15.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 podman[99262]: 2024-09-20 23:23:14.941479432 +0000 UTC m=+0.016117302 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:23:15.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 podman[99262]: 2024-09-20 23:23:15.248746963 +0000 UTC m=+0.323384827 container init 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-20T23:23:15.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 podman[99262]: 2024-09-20 23:23:15.25204415 +0000 UTC m=+0.326682004 container start 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T23:23:15.289 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: pidfile_write: ignore empty --pid-file 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: load: jerasure load: lrc 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Git sha 0 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: DB SUMMARY 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: DB Session ID: QPZ8NXWLRC7DNPPJZJLZ 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: MANIFEST file: MANIFEST-000053 size: 277 Bytes 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000048.sst 000051.sst 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000052.log size: 2861313 ; 2024-09-20T23:23:15.290 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:23:15.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.env: 0x55e46e305940 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.info_log: 0x55e4701a16e0 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.statistics: (nil) 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.use_fsync: 0 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:23:15.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.db_log_dir: 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.wal_dir: 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:23:15.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.write_buffer_manager: 0x55e4701b08c0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:23:15.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.unordered_write: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.row_cache: None 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.wal_filter: None 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.wal_compression: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:23:15.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:23:15.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_open_files: -1 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Compression algorithms supported: 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kZSTD supported: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:23:15.297 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000053 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.merge_operator: 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_filter: None 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:23:15.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e4701a1320) 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_type: 0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_shortening: 1 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: checksum: 4 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: no_block_cache: 0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache: 0x55e4701951f0 2024-09-20T23:23:15.299 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_options: 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: capacity : 536870912 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size: 4096 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: partition_filters: 0 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:23:15.300 INFO:journalctl@ceph.mon.a.smithi170.stdout: filter_policy: bloomfilter 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: verify_compression: 0 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: format_version: 5 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_align: 0 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: prepopulate_block_cache: 0 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:23:15.301 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression: NoCompression 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.num_levels: 7 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:23:15.302 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:23:15.303 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:23:15.304 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:23:15.305 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:23:15.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.ttl: 2592000 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 48.sst 2024-09-20T23:23:15.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000053 succeeded,manifest_file_number is 53, next_file_number is 55, last_sequence is 25895, log_number is 47,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 47 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 47 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 14c53d63-47d9-433c-860a-bf61c8779653 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874595278154, "job": 1, "event": "recovery_started", "wal_files": [52]} 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #52 mode 2 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874595286316, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 56, "file_size": 2689840, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 25898, "largest_seqno": 27016, "table_properties": {"data_size": 2684237, "index_size": 3022, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14348, "raw_average_key_size": 23, "raw_value_size": 2672633, "raw_average_value_size": 4439, "num_data_blocks": 134, "num_entries": 602, "num_filter_entries": 602, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726874595, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "14c53d63-47d9-433c-860a-bf61c8779653", "db_session_id": "QPZ8NXWLRC7DNPPJZJLZ", "orig_file_number": 56, "seqno_to_time_mapping": "N/A"}} 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874595286432, "job": 1, "event": "recovery_finished"} 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:5047] Creating manifest 58 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000052.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e4701c2e00 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: DB pointer 0x55e4702be000 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:23:15.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** DB Stats ** 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: L0 2/0 3.68 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: L6 1/0 9.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:23:15.309 INFO:journalctl@ceph.mon.a.smithi170.stdout: Sum 3/0 13.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 611.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 611.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:23:15.310 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative compaction: 0.00 GB write, 240.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval compaction: 0.00 GB write, 240.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache BinnedLRUCache@0x55e4701951f0#2 capacity: 512.00 MB usage: 9.72 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,4.06 KB,0.00077486%) IndexBlock(2,5.66 KB,0.00107884%) Misc(1,0.00 KB,0%) 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: starting mon.a rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???) e3 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).mds e1 new map 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).mds e1 print_map 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: e1 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:23:15.311 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout: No filesystems configured 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:15.312 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 ceph-mon[99281]: mon.a@-1(???).paxosservice(auth 1..26) refresh upgraded, format 0 -> 3 2024-09-20T23:23:15.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 bash[99262]: 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 2024-09-20T23:23:15.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:15 smithi170 systemd[1]: Started Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:23:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:15] "GET /metrics HTTP/1.1" 200 38274 "" "Prometheus/2.43.0" 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: mon.a calling monitor election 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: monmap epoch 3 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: min_mon_release 17 (quincy) 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: election_strategy: 1 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:16.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: fsmap 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: mgrmap e49: x(active, since 18s), standbys: y 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='' 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:16.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: mon.a calling monitor election 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: monmap epoch 3 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: min_mon_release 17 (quincy) 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: election_strategy: 1 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: fsmap 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: mgrmap e49: x(active, since 18s), standbys: y 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: overall HEALTH_OK 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='' 2024-09-20T23:23:16.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:16.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:16.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:16.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:16 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:17.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: mon.a calling monitor election 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: monmap epoch 3 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: min_mon_release 17 (quincy) 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: election_strategy: 1 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: fsmap 2024-09-20T23:23:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: mgrmap e49: x(active, since 18s), standbys: y 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='' 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.022 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.022 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.022 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.022 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.022 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.023 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.024 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.025 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.026 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.027 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.028 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.029 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.029 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.029 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.029 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:17 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:18.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:18 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.077 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.078 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.084 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:18 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:19.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.945 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.947 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:19.948 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:20.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:20.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.041 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:21.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:21.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:21.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:21.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:20 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.031 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.032 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.033 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.034 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.035 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.036 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:21 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:21 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.037 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.038 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.042 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.044 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.045 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.184 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.185 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.186 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.187 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.187 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.187 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.187 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.190 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.190 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.190 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.190 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:22 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.760 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:23.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:23.952 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.953 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:23.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.154 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.155 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.156 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:24.157 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:23 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.075 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.076 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.077 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.078 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.079 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:24 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.147 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:25.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.150 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.155 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:25] "GET /metrics HTTP/1.1" 200 38274 "" "Prometheus/2.43.0" 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:25 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:25 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.935 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.940 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.941 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.942 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:26.943 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:26.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:26.944 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:26 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:27 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:27 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:28.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:28 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.040 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.041 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.042 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.043 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.044 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.045 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.046 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:29.047 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:28 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.064 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.070 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:30.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:29 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:31.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:30 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.068 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.069 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.070 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.073 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.074 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.075 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.076 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:31 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.936 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[99281]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.937 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:32.938 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:32.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:32.939 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:32 smithi170 ceph-mon[28691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:33.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:33.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:32 smithi191 ceph-mon[24760]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:33.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:34 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:34 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:34 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-mon[24760]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:35.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:35.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[99281]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[28691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[28691]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:35.480 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:35.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:35.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:35 smithi170 ceph-mon[28691]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:36.216 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:35] "GET /metrics HTTP/1.1" 200 38270 "" "Prometheus/2.43.0" 2024-09-20T23:23:36.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:36 smithi170 ceph-mon[99281]: Upgrade: Updating mon.c 2024-09-20T23:23:36.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:36 smithi170 ceph-mon[99281]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:36.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:36 smithi170 ceph-mon[28691]: Upgrade: Updating mon.c 2024-09-20T23:23:36.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:36 smithi170 ceph-mon[28691]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:36.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:36 smithi191 ceph-mon[24760]: Upgrade: Updating mon.c 2024-09-20T23:23:36.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:36 smithi191 ceph-mon[24760]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:37 smithi170 ceph-mon[99281]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:37 smithi170 ceph-mon[28691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:37 smithi191 ceph-mon[24760]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:37.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:37 smithi170 systemd[1]: Stopping Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:23:38.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[28632]: 2024-09-20T23:23:37.780+0000 7f517b380700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:23:38.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[28632]: 2024-09-20T23:23:37.780+0000 7f517b380700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-20T23:23:38.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:37 smithi170 podman[105406]: 2024-09-20 23:23:37.852436262 +0000 UTC m=+0.190006580 container died 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, architecture=x86_64, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, GIT_CLEAN=True, release=754, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:23:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 podman[105406]: 2024-09-20 23:23:38.239308198 +0000 UTC m=+0.576878516 container cleanup 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, vcs-type=git, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, GIT_CLEAN=True, io.openshift.expose-services=, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, name=centos-stream, RELEASE=HEAD, version=8, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, com.redhat.component=centos-stream-container, release=754) 2024-09-20T23:23:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 bash[105406]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c 2024-09-20T23:23:38.872 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 podman[105418]: 2024-09-20 23:23:38.533931003 +0000 UTC m=+0.680748187 container remove 85fb1d400a6a57c6f7b08811dad6c428b0c49a3c96075f1e42cf73b932f012ad (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, maintainer=Guillaume Abrioux , version=8, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, RELEASE=HEAD, vcs-type=git, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, name=centos-stream) 2024-09-20T23:23:38.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-20T23:23:38.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 systemd[1]: Stopped Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:23:38.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service: Consumed 12.152s CPU time. 2024-09-20T23:23:38.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:38 smithi170 systemd[1]: Starting Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:23:38.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:39.166 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 podman[105548]: 2024-09-20 23:23:38.98142667 +0000 UTC m=+0.015925764 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:23:39.166 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 podman[105548]: 2024-09-20 23:23:39.084093575 +0000 UTC m=+0.118592659 container create f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-20T23:23:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 podman[105548]: 2024-09-20 23:23:39.312042391 +0000 UTC m=+0.346541486 container init f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 podman[105548]: 2024-09-20 23:23:39.315294128 +0000 UTC m=+0.349793216 container start f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: pidfile_write: ignore empty --pid-file 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: load: jerasure load: lrc 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Git sha 0 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: DB SUMMARY 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: DB Session ID: 9MY3X0Y2YB0QIZI6L2NC 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:23:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2249 Bytes 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000045.sst 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000043.log size: 1903007 ; 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.env: 0x559ce3eb2940 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.info_log: 0x559ce4cc16e0 2024-09-20T23:23:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.statistics: (nil) 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.use_fsync: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:23:39.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.db_log_dir: 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.wal_dir: 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.write_buffer_manager: 0x559ce4cd08c0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:23:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.unordered_write: 0 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.row_cache: None 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.wal_filter: None 2024-09-20T23:23:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:23:39.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:23:39.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:23:39.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.wal_compression: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:23:39.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_open_files: -1 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:23:39.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Compression algorithms supported: 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kZSTD supported: 0 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:23:39.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.merge_operator: 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_filter: None 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559ce4cc1320) 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_type: 0 2024-09-20T23:23:39.503 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_shortening: 1 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: checksum: 4 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: no_block_cache: 0 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache: 0x559ce4cb51f0 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_options: 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: capacity : 536870912 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size: 4096 2024-09-20T23:23:39.504 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: partition_filters: 0 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: filter_policy: bloomfilter 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: verify_compression: 0 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: format_version: 5 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_align: 0 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: prepopulate_block_cache: 0 2024-09-20T23:23:39.505 INFO:journalctl@ceph.mon.c.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression: NoCompression 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.num_levels: 7 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:23:39.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:23:39.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:23:39.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:23:39.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:23:39.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.ttl: 2592000 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:23:39.511 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 45.sst 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 47, last_sequence is 29336, log_number is 43,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 43 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6fc25ff4-d06c-47f9-8fea-d847d369509e 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874619341790, "job": 1, "event": "recovery_started", "wal_files": [43]} 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #43 mode 2 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874619348151, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 48, "file_size": 1218586, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 29341, "largest_seqno": 31676, "table_properties": {"data_size": 1211044, "index_size": 2980, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3525, "raw_key_size": 31534, "raw_average_key_size": 22, "raw_value_size": 1189320, "raw_average_value_size": 852, "num_data_blocks": 120, "num_entries": 1395, "num_filter_entries": 1395, "num_deletions": 262, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726874619, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6fc25ff4-d06c-47f9-8fea-d847d369509e", "db_session_id": "9MY3X0Y2YB0QIZI6L2NC", "orig_file_number": 48, "seqno_to_time_mapping": "N/A"}} 2024-09-20T23:23:39.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874619348261, "job": 1, "event": "recovery_finished"} 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:5047] Creating manifest 50 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000043.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559ce4ce2e00 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: DB pointer 0x559ce4dde000 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** DB Stats ** 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:23:39.513 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: L0 1/0 1.16 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 386.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: L6 1/0 11.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Sum 2/0 13.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 386.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 386.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:23:39.514 INFO:journalctl@ceph.mon.c.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 386.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative compaction: 0.00 GB write, 132.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval compaction: 0.00 GB write, 132.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:23:39.515 INFO:journalctl@ceph.mon.c.smithi170.stdout: Block cache BinnedLRUCache@0x559ce4cb51f0#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: starting mon.c rank 1 at public addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] at bind addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???) e3 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).mds e1 new map 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).mds e1 print_map 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: e1 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout: No filesystems configured 2024-09-20T23:23:39.516 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 ceph-mon[105567]: mon.c@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 bash[105548]: f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 2024-09-20T23:23:39.517 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:39 smithi170 systemd[1]: Started Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:23:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: mon.c calling monitor election 2024-09-20T23:23:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: mon.a calling monitor election 2024-09-20T23:23:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: monmap epoch 3 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: min_mon_release 17 (quincy) 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: election_strategy: 1 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: fsmap 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: mgrmap e49: x(active, since 41s), standbys: y 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:40 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: mon.c calling monitor election 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: mon.a calling monitor election 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: monmap epoch 3 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: min_mon_release 17 (quincy) 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: election_strategy: 1 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:40.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: fsmap 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: mgrmap e49: x(active, since 41s), standbys: y 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: mon.c calling monitor election 2024-09-20T23:23:40.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: mon.a calling monitor election 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: monmap epoch 3 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: min_mon_release 17 (quincy) 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: election_strategy: 1 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: fsmap 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: mgrmap e49: x(active, since 41s), standbys: y 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: overall HEALTH_OK 2024-09-20T23:23:40.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:40.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:40 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.968 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.969 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.971 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.973 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.974 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.975 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:41.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:41 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.709 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.710 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.711 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.712 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.713 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.714 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.716 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.717 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.718 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.718 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.718 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.718 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:23:42.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.719 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.721 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.725 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:42.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:42.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:42 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 10s ago 14m - - 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 17s ago 14m - - 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (3m) 10s ago 9m 27.4M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (3m) 17s ago 8m 52.6M - dad864ee21e9 db20e8680365 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (2m) 10s ago 7m 49.9M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:23:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (2m) 17s ago 13m 497M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (76s) 10s ago 15m 438M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (28s) 10s ago 15m 38.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (13m) 17s ago 13m 60.5M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 starting - - - 2048M 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (4m) 10s ago 9m 16.5M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (3m) 17s ago 9m 15.5M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (13m) 10s ago 13m 55.9M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (12m) 10s ago 12m 56.6M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (12m) 10s ago 12m 49.9M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (12m) 10s ago 12m 53.5M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (11m) 17s ago 11m 54.5M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (11m) 17s ago 11m 54.3M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (10m) 17s ago 10m 50.9M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (10m) 17s ago 10m 53.0M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:23:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (2m) 17s ago 9m 58.6M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:23:43.406 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (7m) 10s ago 7m 72.2M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:23:43.406 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (7m) 17s ago 7m 74.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:23:43.406 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (7m) 10s ago 7m 73.0M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:23:43.406 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (7m) 17s ago 7m 72.4M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:23:43.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.670 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='client.54102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='client.54102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:23:43.839 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:23:43.840 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-09-20T23:23:43.841 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:23:43.841 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:23:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:23:43.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='client.54102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:43.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:43 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "3/23 daemons upgraded", 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:23:44.197 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:23:44.631 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:23:44.359+0000 7f181fc79640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-20T23:23:44.631 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:44.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.632 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.644 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:23:44.936 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/1993176714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.938 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='client.54126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.939 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.940 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:44 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1993176714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='client.? 172.21.15.170:0/1993176714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='client.54126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:44.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='client.54126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:44 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.633 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/3187314540' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.913 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.914 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.915 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.980 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.980 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.980 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3187314540' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:45.980 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.980 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='client.? 172.21.15.170:0/3187314540' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:45.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:45.988 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:45.988 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:45 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:45] "GET /metrics HTTP/1.1" 200 38213 "" "Prometheus/2.43.0" 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:46.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:46 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:46.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:46 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.637 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.638 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.639 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.958 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.959 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.960 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:47.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:47.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:47.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:47.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:47.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:47.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:47 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.898 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:48.899 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.901 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.902 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:48.903 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:48 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:48.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:48.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:48.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:48.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:48.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:48.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:48 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.909 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:49.910 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.911 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:49 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:49.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:49 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.886 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.886 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.886 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.887 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.888 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.889 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.890 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.891 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.892 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.893 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.894 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:50.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:50.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:50.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:50.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:50.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:50 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.842 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.842 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.842 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.843 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.844 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.847 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.848 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.849 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.850 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:51 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:51.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:51 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.645 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.646 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:52 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:52.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:52.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:53.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:53 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:53.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:53.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:23:54.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:53 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-20T23:23:54.972 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:54.972 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[99281]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:54.972 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[99281]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:54.972 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[105567]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:54.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[105567]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:54.973 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:54 smithi170 ceph-mon[105567]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:54.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:54 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:23:54.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:54 smithi191 ceph-mon[24760]: Upgrade: It appears safe to stop mon.c 2024-09-20T23:23:54.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:54 smithi191 ceph-mon[24760]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:56.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:23:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:23:55] "GET /metrics HTTP/1.1" 200 38213 "" "Prometheus/2.43.0" 2024-09-20T23:23:56.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:56 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:56 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:56 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:56 smithi191 ceph-mon[24760]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[99281]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:56.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:56.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:56 smithi170 ceph-mon[105567]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:23:57.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: Upgrade: Updating mon.c 2024-09-20T23:23:57.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:57.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:57.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:57.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[105567]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: Upgrade: Updating mon.c 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.705 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: Upgrade: Updating mon.c 2024-09-20T23:23:57.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:23:57.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:23:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: Deploying daemon mon.c on smithi170 2024-09-20T23:23:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:57.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:57 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:23:58.660 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:58 smithi191 ceph-mon[24760]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:58.660 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:58 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:58.742 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:58 smithi170 ceph-mon[99281]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:58.742 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:58.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:58 smithi170 ceph-mon[105567]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:23:58.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:58 smithi170 ceph-mon[105567]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:23:58.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:23:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:23:58.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:23:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:23:59 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:59 smithi170 ceph-mon[105567]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:23:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:23:59 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:00.186 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:23:59 smithi170 systemd[1]: Stopping Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[105563]: 2024-09-20T23:24:00.184+0000 7fac24ba9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:24:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[105563]: 2024-09-20T23:24:00.184+0000 7fac24ba9640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-20T23:24:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 podman[111234]: 2024-09-20 23:24:00.216192128 +0000 UTC m=+0.145283170 container died f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70) 2024-09-20T23:24:00.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 podman[111234]: 2024-09-20 23:24:00.584552511 +0000 UTC m=+0.513643544 container cleanup f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T23:24:00.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 bash[111234]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c 2024-09-20T23:24:01.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:00 smithi170 podman[111246]: 2024-09-20 23:24:00.861145412 +0000 UTC m=+0.642468240 container remove f95266a4ae90463385d63e9a614bbafc820ecbd3d933d75f6fdecb78073da511 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-20T23:24:01.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-20T23:24:01.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 systemd[1]: Stopped Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:01.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service: Consumed 1.349s CPU time. 2024-09-20T23:24:01.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 systemd[1]: Starting Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:01.708 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 podman[111373]: 2024-09-20 23:24:01.33723475 +0000 UTC m=+0.016286732 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:24:01.708 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 podman[111373]: 2024-09-20 23:24:01.445800121 +0000 UTC m=+0.124852093 container create bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-20T23:24:01.708 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 podman[111373]: 2024-09-20 23:24:01.681485155 +0000 UTC m=+0.360537141 container init bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-20T23:24:01.708 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 podman[111373]: 2024-09-20 23:24:01.684940246 +0000 UTC m=+0.363992216 container start bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-20T23:24:01.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: pidfile_write: ignore empty --pid-file 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: load: jerasure load: lrc 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Git sha 0 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: DB SUMMARY 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: DB Session ID: H5W1SK91PV1W4WJLWMB9 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: MANIFEST file: MANIFEST-000050 size: 523 Bytes 2024-09-20T23:24:01.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000055.sst 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000053.log size: 1122128 ; 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.env: 0x5581b52f2940 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.info_log: 0x5581b70bf6e0 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.statistics: (nil) 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.use_fsync: 0 2024-09-20T23:24:01.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.db_log_dir: 2024-09-20T23:24:01.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.wal_dir: 2024-09-20T23:24:01.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:24:01.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:24:01.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:24:01.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.write_buffer_manager: 0x5581b70ce8c0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.unordered_write: 0 2024-09-20T23:24:01.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.row_cache: None 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.wal_filter: None 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.wal_compression: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:24:01.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:24:02.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_open_files: -1 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Compression algorithms supported: 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kZSTD supported: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:24:02.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000050 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.merge_operator: 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_filter: None 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:24:02.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5581b70bf320) 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_type: 0 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_index_type: 0 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_shortening: 1 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: checksum: 4 2024-09-20T23:24:02.003 INFO:journalctl@ceph.mon.c.smithi170.stdout: no_block_cache: 0 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache: 0x5581b70b31f0 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_options: 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: capacity : 536870912 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: num_shard_bits : 4 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: strict_capacity_limit : 0 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_cache_compressed: (nil) 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: persistent_cache: (nil) 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size: 4096 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_size_deviation: 10 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_restart_interval: 16 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi170.stdout: index_block_restart_interval: 1 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: metadata_block_size: 4096 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: partition_filters: 0 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: use_delta_encoding: 1 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: filter_policy: bloomfilter 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: whole_key_filtering: 1 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: verify_compression: 0 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: format_version: 5 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_index_compression: 1 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: block_align: 0 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: prepopulate_block_cache: 0 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:24:02.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression: NoCompression 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.num_levels: 7 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:24:02.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:24:02.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:24:02.008 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:24:02.009 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.ttl: 2592000 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:24:02.010 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000050 succeeded,manifest_file_number is 50, next_file_number is 57, last_sequence is 33024, log_number is 53,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 53 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 53 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6fc25ff4-d06c-47f9-8fea-d847d369509e 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874641712648, "job": 1, "event": "recovery_started", "wal_files": [53]} 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #53 mode 2 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874641718653, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 58, "file_size": 698455, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 33029, "largest_seqno": 34031, "table_properties": {"data_size": 694390, "index_size": 1617, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 13603, "raw_average_key_size": 24, "raw_value_size": 685156, "raw_average_value_size": 1234, "num_data_blocks": 66, "num_entries": 555, "num_filter_entries": 555, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726874641, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6fc25ff4-d06c-47f9-8fea-d847d369509e", "db_session_id": "H5W1SK91PV1W4WJLWMB9", "orig_file_number": 58, "seqno_to_time_mapping": "N/A"}} 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874641718782, "job": 1, "event": "recovery_finished"} 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:5047] Creating manifest 60 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:02.011 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000053.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5581b70e0e00 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: DB pointer 0x5581b71dc000 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** DB Stats ** 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:02.012 INFO:journalctl@ceph.mon.c.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: L0 1/0 682.08 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: L6 1/0 12.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Sum 2/0 12.93 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 222.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-20T23:24:02.013 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: Cumulative compaction: 0.00 GB write, 77.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: Interval compaction: 0.00 GB write, 77.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: Block cache BinnedLRUCache@0x5581b70b31f0#2 capacity: 512.00 MB usage: 3.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: starting mon.c rank 1 at public addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] at bind addrs [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???) e3 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).mds e1 new map 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).mds e1 print_map 2024-09-20T23:24:02.014 INFO:journalctl@ceph.mon.c.smithi170.stdout: e1 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: legacy client fscid: -1 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout: No filesystems configured 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 ceph-mon[111392]: mon.c@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 bash[111373]: bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 2024-09-20T23:24:02.015 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:01 smithi170 systemd[1]: Started Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:03.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: mon.c calling monitor election 2024-09-20T23:24:03.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: mon.a calling monitor election 2024-09-20T23:24:03.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:03.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: monmap epoch 3 2024-09-20T23:24:03.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: min_mon_release 17 (quincy) 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: election_strategy: 1 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: fsmap 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: mgrmap e49: x(active, since 63s), standbys: y 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: mon.c calling monitor election 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: mon.a calling monitor election 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: monmap epoch 3 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:03.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: min_mon_release 17 (quincy) 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: election_strategy: 1 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: fsmap 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: mgrmap e49: x(active, since 63s), standbys: y 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: overall HEALTH_OK 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.057 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.058 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.059 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: mon.c calling monitor election 2024-09-20T23:24:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: mon.a calling monitor election 2024-09-20T23:24:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: monmap epoch 3 2024-09-20T23:24:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: last_changed 2024-09-20T23:09:47.954986+0000 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: min_mon_release 17 (quincy) 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: election_strategy: 1 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: fsmap 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: mgrmap e49: x(active, since 63s), standbys: y 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: overall HEALTH_OK 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:03.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:03.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:03.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:03.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:02 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:03.797 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:04.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.142 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.143 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.145 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.146 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.147 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.148 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.149 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.150 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:03 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.963 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.966 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.967 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:04 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:04.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:04.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:05.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:05.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:05.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.104 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.105 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.107 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.108 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.109 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:05] "GET /metrics HTTP/1.1" 200 38283 "" "Prometheus/2.43.0" 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:05 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.976 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.977 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.979 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.980 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.981 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.982 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.985 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.987 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:06.988 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:06.989 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:06 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:07 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.233 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.234 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.235 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.237 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.238 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.239 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:08.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:08 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:08.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.981 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.982 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.983 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.985 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.986 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.987 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.988 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:09.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:09 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:10.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:10 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:11 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:12.252 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.135 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.136 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.137 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.138 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.139 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.140 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.141 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.142 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.143 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:12 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:13.809 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:13.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.130 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.131 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.132 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:13 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:14.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.031 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:15.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:15.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:15.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:15.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:14 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 18s ago 15m - - 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 9s ago 14m - - 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (4m) 18s ago 9m 27.4M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (3m) 9s ago 9m 52.7M - dad864ee21e9 db20e8680365 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (2m) 18s ago 8m 50.1M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (3m) 9s ago 14m 504M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (108s) 18s ago 15m 440M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (60s) 18s ago 15m 45.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (14m) 9s ago 14m 67.4M 2048M 17.2.0 e1d6a67b021e 86a5d21eca57 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 starting - - - 2048M 2024-09-20T23:24:15.722 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (4m) 18s ago 10m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (3m) 9s ago 10m 15.5M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (13m) 18s ago 13m 55.9M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (13m) 18s ago 13m 56.6M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (13m) 18s ago 13m 50.0M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (12m) 18s ago 12m 53.6M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (12m) 9s ago 12m 54.7M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (11m) 9s ago 11m 54.6M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (11m) 9s ago 11m 51.1M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (11m) 9s ago 11m 53.2M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (2m) 9s ago 10m 59.0M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (8m) 18s ago 8m 72.4M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (8m) 9s ago 8m 74.7M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (8m) 18s ago 8m 73.3M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:24:15.723 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (8m) 9s ago 8m 72.6M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:24:16.127 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:15] "GET /metrics HTTP/1.1" 200 38281 "" "Prometheus/2.43.0" 2024-09-20T23:24:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.129 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.130 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.131 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.132 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.132 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.132 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.132 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.132 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:15 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:24:16.152 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:24:16.153 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:24:16.153 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:16.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:16.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:16.497 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "3/23 daemons upgraded", 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:24:16.498 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:24:16.925 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='client.74107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='client.74113 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/315671402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='client.74107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='client.74113 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/315671402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.085 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.086 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-20T23:24:17.089 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='client.74107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='client.74113 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/315671402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T23:24:17.093 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:16 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-20T23:24:17.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: Upgrade: It appears safe to stop mon.b 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2122336033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:17.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: Upgrade: It appears safe to stop mon.b 2024-09-20T23:24:17.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2122336033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:17.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:17.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: Upgrade: It appears safe to stop mon.b 2024-09-20T23:24:18.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: from='client.? 172.21.15.170:0/2122336033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:18.085 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:18.085 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:18.085 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:17 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:18.924 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:18.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:19.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:19.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: Upgrade: Updating mon.b 2024-09-20T23:24:19.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[99281]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: Upgrade: Updating mon.b 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:19.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:19 smithi170 ceph-mon[111392]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: Upgrade: Updating mon.b 2024-09-20T23:24:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:19.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 ceph-mon[24760]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:20.134 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:19 smithi191 systemd[1]: Stopping Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:20.418 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE Bus STOPPING 2024-09-20T23:24:20.418 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[24731]: 2024-09-20T23:24:20.130+0000 7fd3917bd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:24:20.418 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[24731]: 2024-09-20T23:24:20.130+0000 7fd3917bd700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-20T23:24:20.419 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 podman[94052]: 2024-09-20 23:24:20.356383419 +0000 UTC m=+0.342811858 container died 86a5d21eca57d7bc91ef8dfde4033e308b87ca5605d59d25dbb3be30d8c746e7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=-17.2.0, release=754, vendor=Red Hat, Inc., ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, name=centos-stream, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, distribution-scope=public, architecture=x86_64, vcs-type=git, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD) 2024-09-20T23:24:20.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:24:20.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE Bus STOPPED 2024-09-20T23:24:20.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE Bus STARTING 2024-09-20T23:24:20.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE Serving on http://:::9283 2024-09-20T23:24:20.727 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:24:20] ENGINE Bus STARTED 2024-09-20T23:24:21.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 podman[94052]: 2024-09-20 23:24:20.739459329 +0000 UTC m=+0.725887757 container cleanup 86a5d21eca57d7bc91ef8dfde4033e308b87ca5605d59d25dbb3be30d8c746e7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-17.2.0, version=8, architecture=x86_64, name=centos-stream, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, com.redhat.component=centos-stream-container, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-09-20T23:24:21.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 bash[94052]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b 2024-09-20T23:24:21.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:20 smithi191 podman[94064]: 2024-09-20 23:24:20.966197575 +0000 UTC m=+0.607294318 container remove 86a5d21eca57d7bc91ef8dfde4033e308b87ca5605d59d25dbb3be30d8c746e7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, version=8, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, release=754, GIT_CLEAN=True, vendor=Red Hat, Inc., distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:24:21.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-20T23:24:21.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 systemd[1]: Stopped Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:21.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b.service: Consumed 17.564s CPU time. 2024-09-20T23:24:21.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 systemd[1]: Starting Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 podman[94207]: 2024-09-20 23:24:21.443965207 +0000 UTC m=+0.016113502 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 podman[94207]: 2024-09-20 23:24:21.567385229 +0000 UTC m=+0.139533557 container create 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 podman[94207]: 2024-09-20 23:24:21.761626084 +0000 UTC m=+0.333774373 container init 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 podman[94207]: 2024-09-20 23:24:21.764987722 +0000 UTC m=+0.337136012 container start 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: pidfile_write: ignore empty --pid-file 2024-09-20T23:24:21.793 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: load: jerasure load: lrc 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Git sha 0 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: DB SUMMARY 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: DB Session ID: Q2HSY8DPAJWITSPZUG1J 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2826 Bytes 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000054.sst 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000052.log size: 0 ; 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:24:21.794 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.env: 0x555da825a940 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.info_log: 0x555da9bd16e0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.statistics: (nil) 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.use_fsync: 0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:24:21.795 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.db_log_dir: 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.wal_dir: 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:24:21.796 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:24:21.797 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.write_buffer_manager: 0x555da9be08c0 2024-09-20T23:24:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:24:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:24:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.unordered_write: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.row_cache: None 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.wal_filter: None 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:24:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.wal_compression: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:24:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_open_files: -1 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:24:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Compression algorithms supported: 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kZSTD supported: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-09-20T23:24:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.merge_operator: 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_filter: None 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555da9bd1320) 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_type: 0 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: data_block_index_type: 0 2024-09-20T23:24:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_shortening: 1 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: checksum: 4 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: no_block_cache: 0 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache: 0x555da9bc51f0 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_options: 2024-09-20T23:24:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout: capacity : 536870912 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: num_shard_bits : 4 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: strict_capacity_limit : 0 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_compressed: (nil) 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: persistent_cache: (nil) 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_size: 4096 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_size_deviation: 10 2024-09-20T23:24:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_restart_interval: 16 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_block_restart_interval: 1 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: metadata_block_size: 4096 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: partition_filters: 0 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: use_delta_encoding: 1 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: filter_policy: bloomfilter 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: whole_key_filtering: 1 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: verify_compression: 0 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: format_version: 5 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: enable_index_compression: 1 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_align: 0 2024-09-20T23:24:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout: max_auto_readahead_size: 262144 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout: prepopulate_block_cache: 0 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression: NoCompression 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.num_levels: 7 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:24:22.236 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:24:22.237 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:24:22.238 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:24:22.239 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:24:22.240 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.ttl: 2592000 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:24:22.241 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 54.sst 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 56, last_sequence is 36630, log_number is 52,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 52 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c6d914d7-1baa-437a-9478-d2141fc10621 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874661792270, "job": 1, "event": "recovery_started", "wal_files": [52]} 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #52 mode 2 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874661792330, "job": 1, "event": "recovery_finished"} 2024-09-20T23:24:22.242 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:5047] Creating manifest 58 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555da9bf2e00 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: DB pointer 0x555da9cee000 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** DB Stats ** 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:22.243 INFO:journalctl@ceph.mon.b.smithi191.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: L6 1/0 11.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Sum 1/0 11.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:22.244 INFO:journalctl@ceph.mon.b.smithi191.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: Block cache BinnedLRUCache@0x555da9bc51f0#2 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:24:22.245 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: starting mon.b rank 2 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???) e3 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).mds e1 new map 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).mds e1 print_map 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: e1 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: legacy client fscid: -1 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout: No filesystems configured 2024-09-20T23:24:22.246 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 ceph-mon[94226]: mon.b@-1(???).paxosservice(auth 1..29) refresh upgraded, format 0 -> 3 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 bash[94207]: 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec 2024-09-20T23:24:22.247 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:21 smithi191 systemd[1]: Started Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:23.698 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:23.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:26.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:25] "GET /metrics HTTP/1.1" 200 38281 "" "Prometheus/2.43.0" 2024-09-20T23:24:28.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:28.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mon.b calling monitor election 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mon.b (rank 2) addr [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] is down (out of quorum) 2024-09-20T23:24:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mon.c calling monitor election 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mon.a calling monitor election 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: monmap epoch 4 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: min_mon_release 19 (squid) 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: election_strategy: 1 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:29.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: fsmap 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: mgrmap e49: x(active, since 90s), standbys: y 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mon.b calling monitor election 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T23:24:29.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mon.b (rank 2) addr [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] is down (out of quorum) 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mon.c calling monitor election 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mon.a calling monitor election 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: monmap epoch 4 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: min_mon_release 19 (squid) 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: election_strategy: 1 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:29.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: fsmap 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: mgrmap e49: x(active, since 90s), standbys: y 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: overall HEALTH_OK 2024-09-20T23:24:29.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:29 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:29.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mon.b calling monitor election 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mon.b (rank 2) addr [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] is down (out of quorum) 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mon.c calling monitor election 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mon.a calling monitor election 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: monmap epoch 4 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:29.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: min_mon_release 19 (squid) 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: election_strategy: 1 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: fsmap 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: mgrmap e49: x(active, since 90s), standbys: y 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: Cluster is now healthy 2024-09-20T23:24:29.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: overall HEALTH_OK 2024-09-20T23:24:29.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:29 smithi191 ceph-mon[94226]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: Upgrade: Updating mon.b 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:30.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:30 smithi191 ceph-mon[94226]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: Upgrade: Updating mon.b 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:30.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[99281]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: Upgrade: Updating mon.b 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: Deploying daemon mon.b on smithi191 2024-09-20T23:24:30.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:30 smithi170 ceph-mon[111392]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:31.937 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:31 smithi191 systemd[1]: Stopping Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:31.937 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:24:31.803+0000 7f181fc79640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-20T23:24:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[94222]: 2024-09-20T23:24:31.934+0000 7f3bb1eed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:24:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[94222]: 2024-09-20T23:24:31.934+0000 7f3bb1eed640 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-09-20T23:24:32.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 podman[95338]: 2024-09-20 23:24:32.16093206 +0000 UTC m=+0.321922354 container died 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:24:32.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 podman[95338]: 2024-09-20 23:24:32.518723712 +0000 UTC m=+0.679713995 container cleanup 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-20T23:24:32.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 bash[95338]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b 2024-09-20T23:24:33.142 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 podman[95350]: 2024-09-20 23:24:32.794968285 +0000 UTC m=+0.630331357 container remove 44108db87564b6d2f0bcfc3d507b1af0010d8cf8fbac0d43933ec409ad5032ec (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-20T23:24:33.142 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-20T23:24:33.142 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:32 smithi191 systemd[1]: Stopped Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:33.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 systemd[1]: Starting Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:24:33.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 podman[95481]: 2024-09-20 23:24:33.254223836 +0000 UTC m=+0.016292443 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:24:33.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 podman[95481]: 2024-09-20 23:24:33.354021438 +0000 UTC m=+0.116090032 container create 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-20T23:24:33.726 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 podman[95481]: 2024-09-20 23:24:33.565140939 +0000 UTC m=+0.327209547 container init 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 podman[95481]: 2024-09-20 23:24:33.568311242 +0000 UTC m=+0.330379836 container start 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 2 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: pidfile_write: ignore empty --pid-file 2024-09-20T23:24:33.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: load: jerasure load: lrc 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: RocksDB version: 7.9.2 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Git sha 0 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: DB SUMMARY 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: DB Session ID: BNGSEIV8MKWAV5CCM7Q8 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: CURRENT file: CURRENT 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: MANIFEST file: MANIFEST-000058 size: 154 Bytes 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000054.sst 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000052.log size: 0 ; 000057.log size: 362398 ; 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.error_if_exists: 0 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.create_if_missing: 0 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.paranoid_checks: 1 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T23:24:33.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.env: 0x5588e4fa4940 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.info_log: 0x5588e5a856e0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.statistics: (nil) 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.use_fsync: 0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_log_file_size: 0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_fallocate: 1 2024-09-20T23:24:33.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.use_direct_reads: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.db_log_dir: 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.wal_dir: 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T23:24:33.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.write_buffer_manager: 0x5588e5a948c0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.unordered_write: 0 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T23:24:33.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.row_cache: None 2024-09-20T23:24:33.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.wal_filter: None 2024-09-20T23:24:33.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.two_write_queues: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.wal_compression: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.atomic_flush: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.log_readahead_size: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T23:24:33.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_background_jobs: 2 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_background_compactions: -1 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_subcompactions: 1 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T23:24:33.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_open_files: -1 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_background_flushes: -1 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Compression algorithms supported: 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kZSTD supported: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kXpressCompression supported: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kBZip2Compression supported: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kLZ4Compression supported: 1 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kZlibCompression supported: 1 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T23:24:33.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: kSnappyCompression supported: 1 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000058 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.merge_operator: 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_filter: None 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5588e5a85320) 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout: cache_index_and_filter_blocks: 1 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T23:24:33.736 INFO:journalctl@ceph.mon.b.smithi191.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: pin_top_level_index_and_filter: 1 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_type: 0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: data_block_index_type: 0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_shortening: 1 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: checksum: 4 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: no_block_cache: 0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache: 0x5588e5a791f0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_name: BinnedLRUCache 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_options: 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: capacity : 536870912 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: num_shard_bits : 4 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: strict_capacity_limit : 0 2024-09-20T23:24:33.737 INFO:journalctl@ceph.mon.b.smithi191.stdout: high_pri_pool_ratio: 0.000 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_cache_compressed: (nil) 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: persistent_cache: (nil) 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_size: 4096 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_size_deviation: 10 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_restart_interval: 16 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: index_block_restart_interval: 1 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: metadata_block_size: 4096 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: partition_filters: 0 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: use_delta_encoding: 1 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: filter_policy: bloomfilter 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: whole_key_filtering: 1 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: verify_compression: 0 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: read_amp_bytes_per_bit: 0 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: format_version: 5 2024-09-20T23:24:33.738 INFO:journalctl@ceph.mon.b.smithi191.stdout: enable_index_compression: 1 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout: block_align: 0 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout: max_auto_readahead_size: 262144 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout: prepopulate_block_cache: 0 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout: initial_auto_readahead_size: 8192 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression: NoCompression 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.num_levels: 7 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T23:24:33.739 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:33.740 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T23:24:33.741 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T23:24:33.742 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T23:24:33.743 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.inplace_update_support: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.bloom_locality: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.max_successive_merges: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T23:24:33.744 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.ttl: 2592000 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enable_blob_files: false 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.min_blob_size: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T23:24:33.745 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 54.sst 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000058 succeeded,manifest_file_number is 58, next_file_number is 60, last_sequence is 36630, log_number is 53,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 53 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c6d914d7-1baa-437a-9478-d2141fc10621 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874673595020, "job": 1, "event": "recovery_started", "wal_files": [52, 57]} 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #52 since it is older than min log to keep #53 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #57 mode 2 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874673597352, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 61, "file_size": 256760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 36645, "largest_seqno": 36802, "table_properties": {"data_size": 254894, "index_size": 572, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2368, "raw_average_key_size": 24, "raw_value_size": 252643, "raw_average_value_size": 2631, "num_data_blocks": 26, "num_entries": 96, "num_filter_entries": 96, "num_deletions": 1, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726874673, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c6d914d7-1baa-437a-9478-d2141fc10621", "db_session_id": "BNGSEIV8MKWAV5CCM7Q8", "orig_file_number": 61, "seqno_to_time_mapping": "N/A"}} 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726874673597483, "job": 1, "event": "recovery_finished"} 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:5047] Creating manifest 63 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000057.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:24:33.746 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000052.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5588e5aa6e00 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: DB pointer 0x5588e5ba2000 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** DB Stats ** 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.747 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: L0 1/0 250.74 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 203.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: L6 1/0 11.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: Sum 2/0 12.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 203.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 203.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** Compaction Stats [default] ** 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 203.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T23:24:33.748 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Cumulative compaction: 0.00 GB write, 45.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Interval compaction: 0.00 GB write, 45.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Block cache BinnedLRUCache@0x5588e5a791f0#2 capacity: 512.00 MB usage: 0.95 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.31 KB,5.96046e-05%) IndexBlock(1,0.64 KB,0.00012219%) Misc(1,0.00 KB,0%) 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T23:24:33.749 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: starting mon.b rank 2 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???) e4 preinit fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).mds e1 new map 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).mds e1 print_map 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: e1 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: legacy client fscid: -1 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout: No filesystems configured 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-09-20T23:24:33.750 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 ceph-mon[95499]: mon.b@-1(???).paxosservice(auth 1..31) refresh upgraded, format 0 -> 3 2024-09-20T23:24:33.751 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 bash[95481]: 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f 2024-09-20T23:24:33.751 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:33 smithi191 systemd[1]: Started Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:24:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:35.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:35] "GET /metrics HTTP/1.1" 200 38340 "" "Prometheus/2.43.0" 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: mon.b calling monitor election 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: mon.a calling monitor election 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: monmap epoch 4 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: min_mon_release 19 (squid) 2024-09-20T23:24:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: election_strategy: 1 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: fsmap 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: mgrmap e49: x(active, since 96s), standbys: y 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: overall HEALTH_OK 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: Reconfiguring mon.a (monmap changed)... 2024-09-20T23:24:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:36 smithi191 ceph-mon[95499]: Reconfiguring daemon mon.a on smithi170 2024-09-20T23:24:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: mon.b calling monitor election 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: mon.a calling monitor election 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: monmap epoch 4 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: min_mon_release 19 (squid) 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: election_strategy: 1 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: fsmap 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: mgrmap e49: x(active, since 96s), standbys: y 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: Reconfiguring mon.a (monmap changed)... 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[99281]: Reconfiguring daemon mon.a on smithi170 2024-09-20T23:24:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: mon.b calling monitor election 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: mon.a calling monitor election 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: monmap epoch 4 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: fsid 243152d6-77a5-11ef-baf5-efdc52797490 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: last_changed 2024-09-20T23:24:28.416037+0000 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: created 2024-09-20T23:08:14.770981+0000 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: min_mon_release 19 (squid) 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: election_strategy: 1 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.a 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: 1: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: 2: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-09-20T23:24:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: fsmap 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: osdmap e115: 8 total, 8 up, 8 in 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: mgrmap e49: x(active, since 96s), standbys: y 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: overall HEALTH_OK 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: Reconfiguring mon.a (monmap changed)... 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:36 smithi170 ceph-mon[111392]: Reconfiguring daemon mon.a on smithi170 2024-09-20T23:24:37.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:37.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[111392]: Reconfiguring mgr.y (monmap changed)... 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[111392]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[99281]: Reconfiguring mgr.y (monmap changed)... 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[99281]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.449 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-mon[95499]: Reconfiguring mgr.y (monmap changed)... 2024-09-20T23:24:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-mon[95499]: Reconfiguring daemon mgr.y on smithi170 2024-09-20T23:24:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:38.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[99281]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:24:39.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:39 smithi170 ceph-mon[111392]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: Reconfiguring mon.c (monmap changed)... 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: Reconfiguring daemon mon.c on smithi170 2024-09-20T23:24:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:39 smithi191 ceph-mon[95499]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:40.476 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:40.086Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephMonDown: template: __alert_CephMonDown:1:427: executing \"__alert_CephMonDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"mon.a\"} on the right hand-side of the operation: [{ceph_daemon=\"mon.a\", ceph_version=\"ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", public_addr=\"172.21.15.170\", rank=\"0\"}, {ceph_daemon=\"mon.a\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", public_addr=\"172.21.15.170\", rank=\"0\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:24:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:24:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:42.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:42 smithi191 ceph-mon[95499]: Reconfiguring osd.0 (monmap changed)... 2024-09-20T23:24:42.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:42 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.0 on smithi170 2024-09-20T23:24:42.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:42 smithi191 ceph-mon[95499]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[99281]: Reconfiguring osd.0 (monmap changed)... 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.0 on smithi170 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[99281]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[111392]: Reconfiguring osd.0 (monmap changed)... 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.0 on smithi170 2024-09-20T23:24:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:42 smithi170 ceph-mon[111392]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:43.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:43.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:24:44.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:44.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:44.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:45.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:45 smithi191 ceph-mon[95499]: Reconfiguring osd.1 (monmap changed)... 2024-09-20T23:24:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:45 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.1 on smithi170 2024-09-20T23:24:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:45 smithi191 ceph-mon[95499]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[99281]: Reconfiguring osd.1 (monmap changed)... 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.1 on smithi170 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[99281]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[111392]: Reconfiguring osd.1 (monmap changed)... 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.1 on smithi170 2024-09-20T23:24:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:45 smithi170 ceph-mon[111392]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:46.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:45] "GET /metrics HTTP/1.1" 200 38354 "" "Prometheus/2.43.0" 2024-09-20T23:24:46.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: Reconfiguring osd.2 (monmap changed)... 2024-09-20T23:24:46.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:24:46.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:46.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.2 on smithi170 2024-09-20T23:24:46.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:46 smithi191 ceph-mon[95499]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:46.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: Reconfiguring osd.2 (monmap changed)... 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.2 on smithi170 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[99281]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:46.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: Reconfiguring osd.2 (monmap changed)... 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.2 on smithi170 2024-09-20T23:24:46.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:46 smithi170 ceph-mon[111392]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:47.293 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:24:47.959 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:24:47.959 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 10s ago 15m - - 2024-09-20T23:24:47.959 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 16s ago 15m - - 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (4m) 10s ago 10m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (4m) 16s ago 10m 53.2M - dad864ee21e9 db20e8680365 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (3m) 10s ago 8m 50.7M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (3m) 16s ago 14m 507M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (2m) 10s ago 16m 440M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (93s) 10s ago 16m 50.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 starting - - - 2048M 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (46s) 10s ago 15m 38.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (5m) 10s ago 10m 16.3M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:24:47.960 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (4m) 16s ago 10m 15.6M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (14m) 10s ago 14m 56.0M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (14m) 10s ago 14m 56.7M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (13m) 10s ago 13m 50.1M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (13m) 10s ago 13m 53.6M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (12m) 16s ago 12m 54.8M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (12m) 16s ago 12m 55.0M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (11m) 16s ago 11m 51.2M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (11m) 16s ago 11m 53.5M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (3m) 16s ago 10m 65.2M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:24:47.961 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (9m) 10s ago 9m 72.5M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:24:47.962 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (9m) 16s ago 8m 74.9M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:24:47.962 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (8m) 10s ago 8m 73.5M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:24:47.962 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (8m) 16s ago 8m 72.8M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: Reconfiguring osd.3 (monmap changed)... 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:47.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:47 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.3 on smithi170 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: Reconfiguring osd.3 (monmap changed)... 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.3 on smithi170 2024-09-20T23:24:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:47.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: Reconfiguring osd.3 (monmap changed)... 2024-09-20T23:24:47.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:24:47.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:47.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:47 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.3 on smithi170 2024-09-20T23:24:48.370 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:24:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:24:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:24:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:24:48.371 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "4/23 daemons upgraded", 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T23:24:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:24:48.721 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:24:48.964 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:48.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='client.54174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='client.74143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='client.74149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:48.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:48 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/800533648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='client.54174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='client.74143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='client.74149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/800533648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='client.54174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='client.74143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='client.74149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:48.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:48 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/800533648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:24:49.129 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:24:49.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:49 smithi191 ceph-mon[95499]: Reconfiguring rgw.foo.smithi170.dfynrq (monmap changed)... 2024-09-20T23:24:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:49 smithi191 ceph-mon[95499]: Reconfiguring daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:24:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:49 smithi191 ceph-mon[95499]: from='client.54198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:49.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:49 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3784652765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[111392]: Reconfiguring rgw.foo.smithi170.dfynrq (monmap changed)... 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[111392]: Reconfiguring daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[111392]: from='client.54198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3784652765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[99281]: Reconfiguring rgw.foo.smithi170.dfynrq (monmap changed)... 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[99281]: Reconfiguring daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[99281]: from='client.54198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:49.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:49 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3784652765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: Reconfiguring rgw.smpl.smithi170.ojglvq (monmap changed)... 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: Reconfiguring daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:24:51.139 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:50 smithi191 ceph-mon[95499]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: Reconfiguring rgw.smpl.smithi170.ojglvq (monmap changed)... 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: Reconfiguring daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[99281]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: Reconfiguring rgw.smpl.smithi170.ojglvq (monmap changed)... 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: Reconfiguring daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:24:51.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:50 smithi170 ceph-mon[111392]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:52.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:52.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T23:24:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T23:24:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:53 smithi191 ceph-mon[95499]: Reconfiguring mgr.x (monmap changed)... 2024-09-20T23:24:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:53 smithi191 ceph-mon[95499]: Reconfiguring daemon mgr.x on smithi191 2024-09-20T23:24:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:53 smithi191 ceph-mon[95499]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[99281]: Reconfiguring mgr.x (monmap changed)... 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[99281]: Reconfiguring daemon mgr.x on smithi191 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[99281]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[111392]: Reconfiguring mgr.x (monmap changed)... 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[111392]: Reconfiguring daemon mgr.x on smithi191 2024-09-20T23:24:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:53 smithi170 ceph-mon[111392]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:53.837 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:53 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:53.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: Reconfiguring osd.4 (monmap changed)... 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.4 on smithi191 2024-09-20T23:24:54.844 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:54 smithi191 ceph-mon[95499]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: Reconfiguring osd.4 (monmap changed)... 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.4 on smithi191 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[99281]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:54.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: Reconfiguring osd.4 (monmap changed)... 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.4 on smithi191 2024-09-20T23:24:54.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:54 smithi170 ceph-mon[111392]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:55.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:55.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:55.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:55.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:55.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:55.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:24:55.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:24:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:24:55] "GET /metrics HTTP/1.1" 200 38354 "" "Prometheus/2.43.0" 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:24:56.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:24:56.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:56.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: Reconfiguring osd.5 (monmap changed)... 2024-09-20T23:24:56.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.5 on smithi191 2024-09-20T23:24:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:24:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: Reconfiguring osd.5 (monmap changed)... 2024-09-20T23:24:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.5 on smithi191 2024-09-20T23:24:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: Reconfiguring osd.5 (monmap changed)... 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.5 on smithi191 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:24:57.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:57.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:57 smithi191 ceph-mon[95499]: Reconfiguring osd.6 (monmap changed)... 2024-09-20T23:24:57.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:57 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.6 on smithi191 2024-09-20T23:24:57.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[99281]: Reconfiguring osd.6 (monmap changed)... 2024-09-20T23:24:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.6 on smithi191 2024-09-20T23:24:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[111392]: Reconfiguring osd.6 (monmap changed)... 2024-09-20T23:24:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.6 on smithi191 2024-09-20T23:24:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:57.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:58.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:24:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:58.977 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:24:58 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:24:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"172.21.15.191:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", cluster_addr=\"172.21.15.170\", device_class=\"ssd\", hostname=\"smithi170\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.170\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:24:59.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:24:59.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:59.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: Reconfiguring osd.7 (monmap changed)... 2024-09-20T23:24:59.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: Reconfiguring daemon osd.7 on smithi191 2024-09-20T23:24:59.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:24:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:59.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: Reconfiguring osd.7 (monmap changed)... 2024-09-20T23:24:59.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: Reconfiguring daemon osd.7 on smithi191 2024-09-20T23:24:59.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: Reconfiguring osd.7 (monmap changed)... 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: Reconfiguring daemon osd.7 on smithi191 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:24:59.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:24:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[99281]: Reconfiguring rgw.foo.smithi191.hyqqaq (monmap changed)... 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[99281]: Reconfiguring daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[99281]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[111392]: Reconfiguring rgw.foo.smithi191.hyqqaq (monmap changed)... 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[111392]: Reconfiguring daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:25:01.117 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:00 smithi170 ceph-mon[111392]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:01.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:00 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:01.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:00 smithi191 ceph-mon[95499]: Reconfiguring rgw.foo.smithi191.hyqqaq (monmap changed)... 2024-09-20T23:25:01.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:00 smithi191 ceph-mon[95499]: Reconfiguring daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:25:01.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:00 smithi191 ceph-mon[95499]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: Reconfiguring rgw.smpl.smithi191.blxmkg (monmap changed)... 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:02 smithi191 ceph-mon[95499]: Reconfiguring daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: Reconfiguring rgw.smpl.smithi191.blxmkg (monmap changed)... 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[99281]: Reconfiguring daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: Reconfiguring rgw.smpl.smithi191.blxmkg (monmap changed)... 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:02 smithi170 ceph-mon[111392]: Reconfiguring daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.338 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-20T23:25:03.339 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.340 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.340 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:03.976 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:25:03 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:25:03.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi170\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"243152d6-77a5-11ef-baf5-efdc52797490\", domainname=\"(none)\", instance=\"smithi170\", job=\"node\", machine=\"x86_64\", nodename=\"smithi170\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all mon 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all crash 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:04.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all mon 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all crash 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:04.411 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all mon 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all crash 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:04.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[99281]: Upgrade: Updating osd.0 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[99281]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[99281]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[111392]: Upgrade: Updating osd.0 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[111392]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:05.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:05 smithi170 ceph-mon[111392]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:05.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:05 smithi191 ceph-mon[95499]: Upgrade: Updating osd.0 2024-09-20T23:25:05.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:05 smithi191 ceph-mon[95499]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:05.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:05 smithi191 ceph-mon[95499]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:05.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:05] "GET /metrics HTTP/1.1" 200 38355 "" "Prometheus/2.43.0" 2024-09-20T23:25:07.190 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:06 smithi170 systemd[1]: Stopping Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:07.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:07 smithi191 ceph-mon[95499]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:07.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:07 smithi170 ceph-mon[99281]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:07.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:07 smithi170 ceph-mon[111392]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:07.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[31946]: 2024-09-20T23:25:07.219+0000 7faf26159700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:25:07.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[31946]: 2024-09-20T23:25:07.219+0000 7faf26159700 -1 osd.0 115 *** Got signal Terminated *** 2024-09-20T23:25:07.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[31946]: 2024-09-20T23:25:07.219+0000 7faf26159700 -1 osd.0 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:25:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:08 smithi191 ceph-mon[95499]: osd.0 marked itself down and dead 2024-09-20T23:25:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:08 smithi170 ceph-mon[99281]: osd.0 marked itself down and dead 2024-09-20T23:25:08.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:08 smithi170 ceph-mon[111392]: osd.0 marked itself down and dead 2024-09-20T23:25:08.813 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:08 smithi170 podman[119334]: 2024-09-20 23:25:08.550704999 +0000 UTC m=+1.439126381 container died 2c59495cadac55df3e4fb306ab2bfca83892863229ba4ec907de1b202d6d3116 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, distribution-scope=public, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , GIT_CLEAN=True, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, ceph=True, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, release=754, build-date=2022-05-03T08:36:31.336870) 2024-09-20T23:25:09.196 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:08 smithi170 podman[119334]: 2024-09-20 23:25:08.910947895 +0000 UTC m=+1.799369274 container cleanup 2c59495cadac55df3e4fb306ab2bfca83892863229ba4ec907de1b202d6d3116 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, version=8, GIT_CLEAN=True, ceph=True, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, com.redhat.component=centos-stream-container, io.openshift.expose-services=) 2024-09-20T23:25:09.196 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:08 smithi170 bash[119334]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0 2024-09-20T23:25:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:09 smithi191 ceph-mon[95499]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:09 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:09 smithi191 ceph-mon[95499]: osdmap e116: 8 total, 7 up, 8 in 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[99281]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[99281]: osdmap e116: 8 total, 7 up, 8 in 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[111392]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:09 smithi170 ceph-mon[111392]: osdmap e116: 8 total, 7 up, 8 in 2024-09-20T23:25:09.494 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119350]: 2024-09-20 23:25:09.206877611 +0000 UTC m=+0.652531925 container remove 2c59495cadac55df3e4fb306ab2bfca83892863229ba4ec907de1b202d6d3116 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, distribution-scope=public, vcs-type=git, maintainer=Guillaume Abrioux , name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, release=754, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, version=8, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-09-20T23:25:09.833 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.433870351 +0000 UTC m=+0.015540870 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:09.833 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.546526797 +0000 UTC m=+0.128197361 container create deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-20T23:25:09.833 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.748959115 +0000 UTC m=+0.330629641 container init deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T23:25:09.834 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.752162471 +0000 UTC m=+0.333833000 container start deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T23:25:09.834 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.832173011 +0000 UTC m=+0.413843532 container attach deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-20T23:25:10.205 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:09 smithi170 podman[119441]: 2024-09-20 23:25:09.943290846 +0000 UTC m=+0.524961368 container died deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:25:10.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:10 smithi191 ceph-mon[95499]: osdmap e117: 8 total, 7 up, 8 in 2024-09-20T23:25:10.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:10 smithi170 ceph-mon[99281]: osdmap e117: 8 total, 7 up, 8 in 2024-09-20T23:25:10.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:10 smithi170 ceph-mon[111392]: osdmap e117: 8 total, 7 up, 8 in 2024-09-20T23:25:10.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:10 smithi170 podman[119464]: 2024-09-20 23:25:10.594856683 +0000 UTC m=+0.645828933 container remove deb03e2330262a1e4aed34ea49f418b5be69ed339efecfd009fb1b86e0bc1916 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-20T23:25:10.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:10 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-20T23:25:10.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:10 smithi170 systemd[1]: Stopped Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:25:10.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:10 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service: Consumed 7.688s CPU time. 2024-09-20T23:25:10.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:10 smithi170 systemd[1]: Starting Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:11.308 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 podman[119561]: 2024-09-20 23:25:10.932672155 +0000 UTC m=+0.016133635 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:11.309 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 podman[119561]: 2024-09-20 23:25:11.04635408 +0000 UTC m=+0.129815600 container create 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: pgmap v71: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 13 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.309 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:11.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: pgmap v71: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:11.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 13 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:11.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: pgmap v71: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 13 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:11.743 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 podman[119561]: 2024-09-20 23:25:11.307566033 +0000 UTC m=+0.391027521 container init 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:25:11.743 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 podman[119561]: 2024-09-20 23:25:11.311736118 +0000 UTC m=+0.395197599 container start 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-20T23:25:11.743 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 podman[119561]: 2024-09-20 23:25:11.398831112 +0000 UTC m=+0.482292701 container attach 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70) 2024-09-20T23:25:11.744 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:11.744 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 bash[119561]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:11.744 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:11.744 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:11 smithi170 bash[119561]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:13.109 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:12 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:13.109 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:12 smithi170 bash[119561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:13.109 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:12 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:13.109 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:12 smithi170 bash[119561]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:13.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[99281]: pgmap v72: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:13.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:13.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 bash[119561]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 bash[119561]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 bash[119561]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 bash[119561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[119575]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 bash[119561]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-20T23:25:13.429 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 podman[119561]: 2024-09-20 23:25:13.141104673 +0000 UTC m=+2.224566152 container died 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:25:13.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[111392]: pgmap v72: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:13.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:13.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:13 smithi191 ceph-mon[95499]: pgmap v72: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:25:13.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:13.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:14.182 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:13 smithi170 podman[119719]: 2024-09-20 23:25:13.812517295 +0000 UTC m=+0.664670811 container remove 6d105836ef1ff87c1d8b6c68d00bfcbfd941757d1ffd3384019a891b7452743c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:25:14.182 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 podman[119776]: 2024-09-20 23:25:13.92895524 +0000 UTC m=+0.016464746 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:14.182 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 podman[119776]: 2024-09-20 23:25:14.054183201 +0000 UTC m=+0.141692706 container create 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:14 smithi170 ceph-mon[111392]: pgmap v73: 161 pgs: 30 active+undersized, 12 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:14 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 53/630 objects degraded (8.413%), 16 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:14 smithi170 ceph-mon[99281]: pgmap v73: 161 pgs: 30 active+undersized, 12 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:14 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 53/630 objects degraded (8.413%), 16 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 podman[119776]: 2024-09-20 23:25:14.315110135 +0000 UTC m=+0.402619652 container init 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T23:25:14.512 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 podman[119776]: 2024-09-20 23:25:14.318413827 +0000 UTC m=+0.405923332 container start 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-20T23:25:14.513 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 ceph-osd[119795]: -- 172.21.15.170:0/4290576366 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa33861a40 con 0x55aa3383fc00 2024-09-20T23:25:14.513 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 bash[119776]: 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d 2024-09-20T23:25:14.513 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:14 smithi170 systemd[1]: Started Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:25:14.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:14 smithi191 ceph-mon[95499]: pgmap v73: 161 pgs: 30 active+undersized, 12 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:25:14.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:14 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 53/630 objects degraded (8.413%), 16 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.641 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.642 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.643 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.644 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: Health check update: Reduced data availability: 2 pgs inactive, 11 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.647 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.648 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: Health check update: Reduced data availability: 2 pgs inactive, 11 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: Health check update: Reduced data availability: 2 pgs inactive, 11 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:15.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:15.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:15.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:15] "GET /metrics HTTP/1.1" 200 38500 "" "Prometheus/2.43.0" 2024-09-20T23:25:16.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:15 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:15.965+0000 7ff55abd2640 -1 Falling back to public interface 2024-09-20T23:25:16.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: pgmap v74: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: pgmap v74: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:16.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: pgmap v74: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:16.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:16.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 11 pgs peering) 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 11 pgs peering) 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 11 pgs peering) 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:17.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:17.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:17.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:17.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.701 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[99281]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.703 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.704 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:18.705 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:18 smithi170 ceph-mon[111392]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T23:25:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: Upgrade: osd.0 is safe to restart 2024-09-20T23:25:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:18 smithi191 ceph-mon[95499]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 67/630 objects degraded (10.635%) 2024-09-20T23:25:19.500 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:25:19.658 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:19 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:19.488+0000 7ff55abd2640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-20T23:25:19.659 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:19 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:19.510+0000 7ff55abd2640 -1 osd.0 115 log_to_monitors true 2024-09-20T23:25:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:19 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:19.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:19 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:20.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:19 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 2s ago 16m - - 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 9s ago 15m - - 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (5m) 2s ago 10m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (4m) 9s ago 10m 51.6M - dad864ee21e9 db20e8680365 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (4m) 2s ago 9m 50.7M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (4m) 9s ago 15m 511M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (2m) 2s ago 16m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:25:20.232 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (2m) 2s ago 17m 53.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (46s) 9s ago 15m 32.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (78s) 2s ago 15m 43.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (5m) 2s ago 11m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (5m) 9s ago 11m 15.6M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (14m) 2s ago 14m 56.1M 4096M 17.2.0 e1d6a67b021e 2c59495cadac 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (14m) 2s ago 14m 56.7M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (14m) 2s ago 14m 50.1M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (13m) 2s ago 13m 53.5M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (13m) 9s ago 13m 54.3M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (12m) 9s ago 12m 55.6M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (12m) 9s ago 12m 52.1M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (12m) 9s ago 12m 54.7M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (4m) 9s ago 11m 65.2M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:25:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (9m) 2s ago 9m 72.6M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:25:20.234 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (9m) 9s ago 9m 75.1M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:25:20.234 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (9m) 2s ago 9m 73.5M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:25:20.234 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (9m) 9s ago 9m 73.0M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:25:20.422 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:20.036+0000 7ff54e975640 -1 osd.0 115 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7 2024-09-20T23:25:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:25:20.647 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:25:20.990 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:25:20.990 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "5/23 daemons upgraded", 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:25:20.991 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='client.54213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: osdmap e118: 8 total, 7 up, 8 in 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='client.74185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.055 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' 2024-09-20T23:25:21.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: pgmap v77: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:21.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='client.54228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:21.056 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3015231293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:21.061 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:21.061 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='client.54213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.061 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: osdmap e118: 8 total, 7 up, 8 in 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='client.74185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: pgmap v77: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='client.54228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:21.062 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:20 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3015231293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:21.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='client.54213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: osdmap e118: 8 total, 7 up, 8 in 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='client.74185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986]' entity='osd.0' 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: pgmap v77: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='client.54228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:20 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3015231293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [7,6] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.0 is active+undersized+degraded, acting [7,1] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1 is active+undersized+degraded, acting [2,3] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.f is active+undersized+degraded, acting [4,7] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.13 is active+undersized+degraded, acting [4,3] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1 is active+undersized+degraded, acting [4,3] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.3 is active+undersized+degraded, acting [4,6] 2024-09-20T23:25:21.427 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.6 is active+undersized+degraded, acting [1,4] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.7 is active+undersized+degraded, acting [3,7] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.b is active+undersized+degraded, acting [3,4] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.f is active+undersized+degraded, acting [7,4] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.10 is active+undersized+degraded, acting [6,5] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.12 is active+undersized+degraded, acting [7,3] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.17 is active+undersized+degraded, acting [5,3] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.18 is active+undersized+degraded, acting [3,1] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1b is active+undersized+degraded, acting [4,7] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1f is active+undersized+degraded, acting [5,2] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.0 is active+undersized+degraded, acting [3,7] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.3 is active+undersized+degraded, acting [5,7] 2024-09-20T23:25:21.428 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.1d is active+undersized+degraded, acting [1,4] 2024-09-20T23:25:22.064 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: from='client.54240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986] boot 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: osdmap e119: 8 total, 8 up, 8 in 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: Upgrade: Updating osd.0 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:22.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1399672324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: from='client.54240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986] boot 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: osdmap e119: 8 total, 8 up, 8 in 2024-09-20T23:25:22.066 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:22.067 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: Upgrade: Updating osd.0 2024-09-20T23:25:22.067 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:22.067 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:22.067 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:22.067 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:21 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1399672324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: from='client.54240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: osd.0 [v2:172.21.15.170:6800/835332986,v1:172.21.15.170:6801/835332986] boot 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: osdmap e119: 8 total, 8 up, 8 in 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: Upgrade: Updating osd.0 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: Deploying daemon osd.0 on smithi170 2024-09-20T23:25:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:21 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1399672324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:23.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:23 smithi170 ceph-mon[99281]: osdmap e120: 8 total, 8 up, 8 in 2024-09-20T23:25:23.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:23 smithi170 ceph-mon[99281]: pgmap v80: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:23.449 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:23 smithi170 ceph-mon[111392]: osdmap e120: 8 total, 8 up, 8 in 2024-09-20T23:25:23.449 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:23 smithi170 ceph-mon[111392]: pgmap v80: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:23.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:23 smithi191 ceph-mon[95499]: osdmap e120: 8 total, 8 up, 8 in 2024-09-20T23:25:23.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:23 smithi191 ceph-mon[95499]: pgmap v80: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:24.313 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:24 smithi191 ceph-mon[95499]: pgmap v81: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:24.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:24 smithi170 ceph-mon[99281]: pgmap v81: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:24.564 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:24 smithi170 ceph-mon[111392]: pgmap v81: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:25] "GET /metrics HTTP/1.1" 200 38500 "" "Prometheus/2.43.0" 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[99281]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.560 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:26 smithi170 ceph-mon[111392]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.656 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:26.657 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:26 smithi191 ceph-mon[95499]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-20T23:25:27.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:27.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:25:27.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:27.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:25:27.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:27 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:27.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:27 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:25:27.942 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:27 smithi170 systemd[1]: Stopping Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:28.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:27.940+0000 7ff557b6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:25:28.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:27.940+0000 7ff557b6a640 -1 osd.0 120 *** Got signal Terminated *** 2024-09-20T23:25:28.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:27 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[119791]: 2024-09-20T23:25:27.940+0000 7ff557b6a640 -1 osd.0 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:25:28.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:28 smithi191 ceph-mon[95499]: osd.0 marked itself down and dead 2024-09-20T23:25:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:28 smithi191 ceph-mon[95499]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:28.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[99281]: osd.0 marked itself down and dead 2024-09-20T23:25:28.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[99281]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:28.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:28.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[111392]: osd.0 marked itself down and dead 2024-09-20T23:25:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[111392]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:29.076 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:28 smithi170 podman[122719]: 2024-09-20 23:25:28.779966457 +0000 UTC m=+0.959533797 container died 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-20T23:25:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:29 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:29 smithi170 ceph-mon[111392]: osdmap e121: 8 total, 7 up, 8 in 2024-09-20T23:25:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:29 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:29 smithi170 ceph-mon[99281]: osdmap e121: 8 total, 7 up, 8 in 2024-09-20T23:25:29.494 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:29 smithi170 podman[122719]: 2024-09-20 23:25:29.265771172 +0000 UTC m=+1.445338547 container cleanup 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-20T23:25:29.494 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:29 smithi170 bash[122719]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0 2024-09-20T23:25:29.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:29 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:29.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:29 smithi191 ceph-mon[95499]: osdmap e121: 8 total, 7 up, 8 in 2024-09-20T23:25:29.814 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:29 smithi170 podman[122735]: 2024-09-20 23:25:29.500222079 +0000 UTC m=+0.721168235 container remove 475e3beed71058cf324cc27a747279d3929207363ab8f56daff3aac7eb40a81d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:25:30.155 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:29 smithi170 podman[122823]: 2024-09-20 23:25:29.715860066 +0000 UTC m=+0.015850204 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:30.155 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:29 smithi170 podman[122823]: 2024-09-20 23:25:29.826090952 +0000 UTC m=+0.126081086 container create b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:25:30.155 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 podman[122823]: 2024-09-20 23:25:30.054001178 +0000 UTC m=+0.353991319 container init b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0) 2024-09-20T23:25:30.155 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 podman[122823]: 2024-09-20 23:25:30.057608565 +0000 UTC m=+0.357598698 container start b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:25:30.156 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 podman[122823]: 2024-09-20 23:25:30.153929582 +0000 UTC m=+0.453919718 container attach b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-20T23:25:30.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 podman[122823]: 2024-09-20 23:25:30.252267467 +0000 UTC m=+0.552257614 container died b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-20T23:25:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[99281]: osdmap e122: 8 total, 7 up, 8 in 2024-09-20T23:25:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[99281]: pgmap v86: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:30.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:30.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[111392]: osdmap e122: 8 total, 7 up, 8 in 2024-09-20T23:25:30.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:30 smithi170 ceph-mon[111392]: pgmap v86: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:30.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:30 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:30 smithi191 ceph-mon[95499]: osdmap e122: 8 total, 7 up, 8 in 2024-09-20T23:25:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:30 smithi191 ceph-mon[95499]: pgmap v86: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:25:31.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 podman[122847]: 2024-09-20 23:25:30.866262511 +0000 UTC m=+0.608030638 container remove b0fba1d3b19fce8467388c676647276ca3c626530f2e93fa3d84a10d2c2a2020 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:25:31.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-20T23:25:31.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 systemd[1]: Stopped Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:25:31.244 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:30 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service: Consumed 1.954s CPU time. 2024-09-20T23:25:31.244 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 systemd[1]: Starting Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 8 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 8 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:31.563 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.564 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 podman[122946]: 2024-09-20 23:25:31.21870283 +0000 UTC m=+0.015900201 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:31.564 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 podman[122946]: 2024-09-20 23:25:31.334463713 +0000 UTC m=+0.131661110 container create 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-20T23:25:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:31 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 8 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-09-20T23:25:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:31.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 podman[122946]: 2024-09-20 23:25:31.56196981 +0000 UTC m=+0.359167183 container init 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-20T23:25:31.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 podman[122946]: 2024-09-20 23:25:31.565533814 +0000 UTC m=+0.362731170 container start 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:25:31.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 podman[122946]: 2024-09-20 23:25:31.653600792 +0000 UTC m=+0.450798147 container attach 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:25:31.994 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:31.994 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 bash[122946]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:31.994 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:31.994 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:31 smithi170 bash[122946]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:32.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:32 smithi191 ceph-mon[95499]: pgmap v87: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:32.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:32 smithi170 ceph-mon[99281]: pgmap v87: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:32.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:32 smithi170 ceph-mon[111392]: pgmap v87: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:25:33.367 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:33.367 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:33.367 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:33.367 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate[122960]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-20T23:25:33.647 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 bash[122946]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-20T23:25:33.648 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:33 smithi170 podman[122946]: 2024-09-20 23:25:33.398561482 +0000 UTC m=+2.195758846 container died 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-20T23:25:34.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:34.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:34.435 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 podman[123093]: 2024-09-20 23:25:34.08274864 +0000 UTC m=+0.677728423 container remove 2e96afac1f6e5d42c8bcb558da0e42d31c7dbb543e90d5294fb943e09319753a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:25:34.435 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 podman[123162]: 2024-09-20 23:25:34.193312111 +0000 UTC m=+0.016545896 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:34.435 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 podman[123162]: 2024-09-20 23:25:34.308698993 +0000 UTC m=+0.131932770 container create 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-20T23:25:34.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:34.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 podman[123162]: 2024-09-20 23:25:34.578121119 +0000 UTC m=+0.401354906 container init 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:25:34.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 podman[123162]: 2024-09-20 23:25:34.581422925 +0000 UTC m=+0.404656701 container start 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-20T23:25:34.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 ceph-osd[123181]: -- 172.21.15.170:0/1702103404 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8e09dda40 con 0x55c8e17a4000 2024-09-20T23:25:34.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 bash[123162]: 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 2024-09-20T23:25:34.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:34 smithi170 systemd[1]: Started Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 8 pgs peering) 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:35.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 8 pgs peering) 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 8 pgs peering) 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:35.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:35] "GET /metrics HTTP/1.1" 200 38510 "" "Prometheus/2.43.0" 2024-09-20T23:25:36.231 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:25:36.216+0000 7f0ab4b18640 -1 Falling back to public interface 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.232 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:36.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:37.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.373 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.374 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.376 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.237 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:25:39.810+0000 7f0ab4b18640 -1 osd.0 120 log_to_monitors true 2024-09-20T23:25:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[111392]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-mon[99281]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:40 smithi191 ceph-mon[95499]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 941 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:41.239 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:25:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:25:40.833+0000 7f0aac8c3640 -1 osd.0 120 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:25:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: osdmap e123: 8 total, 7 up, 8 in 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: osdmap e123: 8 total, 7 up, 8 in 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: osdmap e123: 8 total, 7 up, 8 in 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611] boot 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: osdmap e124: 8 total, 8 up, 8 in 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[111392]: pgmap v94: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611] boot 2024-09-20T23:25:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: osdmap e124: 8 total, 8 up, 8 in 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:42 smithi170 ceph-mon[99281]: pgmap v94: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: osd.0 [v2:172.21.15.170:6800/3076548611,v1:172.21.15.170:6801/3076548611] boot 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: osdmap e124: 8 total, 8 up, 8 in 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:42 smithi191 ceph-mon[95499]: pgmap v94: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-09-20T23:25:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: osdmap e125: 8 total, 8 up, 8 in 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: osdmap e125: 8 total, 8 up, 8 in 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: osdmap e125: 8 total, 8 up, 8 in 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:44.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.475 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.476 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.478 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: pgmap v96: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: pgmap v96: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:44.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.507 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.508 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.509 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.510 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: pgmap v96: 161 pgs: 13 active+undersized, 8 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 30/630 objects degraded (4.762%) 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:44.511 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.464 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.465 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.466 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.468 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.476 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.477 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:45.590 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:45.591 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:45.591 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:45.591 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:45.591 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:45.591 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:45] "GET /metrics HTTP/1.1" 200 38434 "" "Prometheus/2.43.0" 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.438 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.440 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[111392]: Upgrade: osd.1 is safe to restart 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:46 smithi170 ceph-mon[99281]: Upgrade: osd.1 is safe to restart 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:25:46.612 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:46 smithi191 ceph-mon[95499]: Upgrade: osd.1 is safe to restart 2024-09-20T23:25:47.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:47 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:47.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:47 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:25:47.460 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:47 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:47.460 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:47 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:25:47.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:47 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/630 objects degraded (4.762%), 8 pgs degraded) 2024-09-20T23:25:47.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:47 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:25:48.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:48 smithi170 ceph-mon[111392]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-20T23:25:48.508 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:48 smithi170 ceph-mon[99281]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-20T23:25:48.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:48 smithi191 ceph-mon[95499]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-20T23:25:49.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:49 smithi191 ceph-mon[95499]: Upgrade: Updating osd.1 2024-09-20T23:25:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:25:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:49.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:49 smithi191 ceph-mon[95499]: Deploying daemon osd.1 on smithi170 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[99281]: Upgrade: Updating osd.1 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[99281]: Deploying daemon osd.1 on smithi170 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[111392]: Upgrade: Updating osd.1 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:49.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:25:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:49 smithi170 ceph-mon[111392]: Deploying daemon osd.1 on smithi170 2024-09-20T23:25:50.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:50 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:50.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:50 smithi191 ceph-mon[95499]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 158 op/s 2024-09-20T23:25:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:50 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:50.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:50 smithi170 ceph-mon[99281]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 158 op/s 2024-09-20T23:25:50.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:50 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:25:50.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:50 smithi170 ceph-mon[111392]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 158 op/s 2024-09-20T23:25:51.798 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:25:52.483 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 0s ago 16m - - 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 1s ago 16m - - 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (6m) 0s ago 11m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (5m) 1s ago 11m 51.9M - dad864ee21e9 db20e8680365 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (4m) 0s ago 9m 52.9M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (4m) 1s ago 15m 514M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (3m) 0s ago 17m 441M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (2m) 0s ago 17m 57.8M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (79s) 1s ago 16m 35.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (111s) 0s ago 16m 41.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (6m) 0s ago 11m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (5m) 1s ago 11m 15.3M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:25:52.484 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (18s) 0s ago 15m 15.3M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (15m) 0s ago 15m 58.1M 4096M 17.2.0 e1d6a67b021e d257cfd0dcbf 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (14m) 0s ago 14m 52.0M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (14m) 0s ago 14m 54.7M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (13m) 1s ago 13m 57.0M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (13m) 1s ago 13m 57.6M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (13m) 1s ago 13m 52.8M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (12m) 1s ago 12m 56.0M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (4m) 1s ago 12m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (10m) 0s ago 10m 72.8M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (10m) 1s ago 10m 75.2M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (9m) 0s ago 9m 73.7M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:25:52.485 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (9m) 1s ago 9m 73.1M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:25:52.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='client.74221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: from='client.74227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:52 smithi191 ceph-mon[95499]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-09-20T23:25:52.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.740 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='client.74221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: from='client.74227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[99281]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.741 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='client.74221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:52.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: from='client.74227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.742 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:52 smithi170 ceph-mon[111392]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:25:52.948 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 1 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:25:52.949 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:25:53.298 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:25:53.298 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:25:53.298 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:25:53.298 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "6/23 daemons upgraded", 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:25:53.299 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:25:53.709 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='client.74233 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3231163125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/694000468' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:53.907 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='client.74233 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3231163125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:53.908 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:53 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/694000468' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='client.74233 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3231163125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:54.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:53 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/694000468' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:25:54.945 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-mon[99281]: from='client.74245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:54.946 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-mon[99281]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 127 op/s 2024-09-20T23:25:54.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-mon[111392]: from='client.74245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:54.946 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-mon[111392]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 127 op/s 2024-09-20T23:25:54.946 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:54 smithi170 systemd[1]: Stopping Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:55.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:54 smithi191 ceph-mon[95499]: from='client.74245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:55.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:54 smithi191 ceph-mon[95499]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 127 op/s 2024-09-20T23:25:55.243 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[34823]: 2024-09-20T23:25:54.943+0000 7fad1979d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:25:55.243 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[34823]: 2024-09-20T23:25:54.943+0000 7fad1979d700 -1 osd.1 125 *** Got signal Terminated *** 2024-09-20T23:25:55.243 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:54 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[34823]: 2024-09-20T23:25:54.943+0000 7fad1979d700 -1 osd.1 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:25:55.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:55 smithi170 ceph-mon[99281]: osd.1 marked itself down and dead 2024-09-20T23:25:55.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:55 smithi170 ceph-mon[111392]: osd.1 marked itself down and dead 2024-09-20T23:25:56.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:55 smithi191 ceph-mon[95499]: osd.1 marked itself down and dead 2024-09-20T23:25:56.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:25:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:25:55] "GET /metrics HTTP/1.1" 200 38434 "" "Prometheus/2.43.0" 2024-09-20T23:25:56.439 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:56 smithi170 podman[128579]: 2024-09-20 23:25:56.138244146 +0000 UTC m=+1.318040754 container died d257cfd0dcbf79aa0f7702304ffb88bfb9eac78cafa01055ed889d2c8e012e85 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, architecture=x86_64, name=centos-stream, vendor=Red Hat, Inc., distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, io.openshift.expose-services=, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream) 2024-09-20T23:25:56.735 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:56 smithi170 podman[128579]: 2024-09-20 23:25:56.610346709 +0000 UTC m=+1.790143361 container cleanup d257cfd0dcbf79aa0f7702304ffb88bfb9eac78cafa01055ed889d2c8e012e85 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, architecture=x86_64, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, maintainer=Guillaume Abrioux , ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, name=centos-stream) 2024-09-20T23:25:56.735 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:56 smithi170 bash[128579]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1 2024-09-20T23:25:56.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:56.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[99281]: osdmap e126: 8 total, 7 up, 8 in 2024-09-20T23:25:56.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[99281]: pgmap v103: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 0 B/s wr, 131 op/s 2024-09-20T23:25:56.994 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:56 smithi170 podman[128595]: 2024-09-20 23:25:56.903767765 +0000 UTC m=+0.759769490 container remove d257cfd0dcbf79aa0f7702304ffb88bfb9eac78cafa01055ed889d2c8e012e85 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, release=754, vcs-type=git, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.openshift.tags=base centos centos-stream, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , ceph=True, io.openshift.expose-services=) 2024-09-20T23:25:56.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:56.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[111392]: osdmap e126: 8 total, 7 up, 8 in 2024-09-20T23:25:56.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:56 smithi170 ceph-mon[111392]: pgmap v103: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 0 B/s wr, 131 op/s 2024-09-20T23:25:57.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:56 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:25:57.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:56 smithi191 ceph-mon[95499]: osdmap e126: 8 total, 7 up, 8 in 2024-09-20T23:25:57.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:56 smithi191 ceph-mon[95499]: pgmap v103: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 0 B/s wr, 131 op/s 2024-09-20T23:25:57.491 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.229605818 +0000 UTC m=+0.112704098 container create 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-20T23:25:57.492 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.13317011 +0000 UTC m=+0.016268401 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.490511383 +0000 UTC m=+0.373609662 container init 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T23:25:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.494223082 +0000 UTC m=+0.377321370 container start 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T23:25:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.582067766 +0000 UTC m=+0.465166062 container attach 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T23:25:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:57 smithi170 podman[128684]: 2024-09-20 23:25:57.684758546 +0000 UTC m=+0.567856836 container died 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:25:57.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:57 smithi191 ceph-mon[95499]: osdmap e127: 8 total, 7 up, 8 in 2024-09-20T23:25:57.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:57 smithi170 ceph-mon[99281]: osdmap e127: 8 total, 7 up, 8 in 2024-09-20T23:25:57.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:57 smithi170 ceph-mon[111392]: osdmap e127: 8 total, 7 up, 8 in 2024-09-20T23:25:58.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 podman[128706]: 2024-09-20 23:25:58.302911463 +0000 UTC m=+0.612373139 container remove 387d7372f9aaf1e0c067ba7e95696b8bfad22dc7329d0c12b16b1a70c9345698 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:25:58.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-20T23:25:58.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 systemd[1]: Stopped Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:25:58.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service: Consumed 8.845s CPU time. 2024-09-20T23:25:58.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 systemd[1]: Starting Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:25:59.080 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 podman[128801]: 2024-09-20 23:25:58.653968586 +0000 UTC m=+0.015656659 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:25:59.080 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:58 smithi170 podman[128801]: 2024-09-20 23:25:58.778870754 +0000 UTC m=+0.140558811 container create c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-20T23:25:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:59 smithi191 ceph-mon[95499]: pgmap v105: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-20T23:25:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:25:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[99281]: pgmap v105: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[111392]: pgmap v105: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:25:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:25:59.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 podman[128801]: 2024-09-20 23:25:59.078978011 +0000 UTC m=+0.440666076 container init c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 podman[128801]: 2024-09-20 23:25:59.082794962 +0000 UTC m=+0.444483030 container start c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 podman[128801]: 2024-09-20 23:25:59.181686273 +0000 UTC m=+0.543374343 container attach c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 bash[128801]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:25:59.494 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:25:59 smithi170 bash[128801]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[99281]: pgmap v106: 161 pgs: 33 active+undersized, 7 peering, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 69 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[111392]: pgmap v106: 161 pgs: 33 active+undersized, 7 peering, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 69 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:00.587 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:00.588 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:00.588 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:00.588 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:00.588 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:00.588 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:00 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:00 smithi191 ceph-mon[95499]: pgmap v106: 161 pgs: 33 active+undersized, 7 peering, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 0 B/s wr, 69 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:00 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[128816]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-20T23:26:00.911 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 bash[128801]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-20T23:26:00.912 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:00 smithi170 podman[128801]: 2024-09-20 23:26:00.617429073 +0000 UTC m=+1.979117138 container died c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-20T23:26:01.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 podman[128963]: 2024-09-20 23:26:01.176828936 +0000 UTC m=+0.552528302 container remove c23ec1e61d095ef2bd6a68e068d23aa61ecda1aebfd61c1f03d5f567c33b8ccf (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T23:26:01.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 podman[129023]: 2024-09-20 23:26:01.286541736 +0000 UTC m=+0.015720311 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:26:01.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 podman[129023]: 2024-09-20 23:26:01.402811524 +0000 UTC m=+0.131990099 container create 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-20T23:26:01.993 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 podman[129023]: 2024-09-20 23:26:01.680653321 +0000 UTC m=+0.409831902 container init 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70) 2024-09-20T23:26:01.993 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 podman[129023]: 2024-09-20 23:26:01.683908502 +0000 UTC m=+0.413087069 container start 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T23:26:01.993 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 ceph-osd[129042]: -- 172.21.15.170:0/452229560 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56466fca7a40 con 0x56466fc85c00 2024-09-20T23:26:01.993 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 bash[129023]: 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 2024-09-20T23:26:01.993 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:01 smithi170 systemd[1]: Started Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:26:03.077 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.077 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.077 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.077 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.077 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.078 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: pgmap v107: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 84 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.080 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: pgmap v107: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 84 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.081 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.082 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.083 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.084 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.085 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: pgmap v107: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 84 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:03.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:03.834 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:03.572+0000 7f1c23f6b640 -1 Falling back to public interface 2024-09-20T23:26:04.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.151 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.152 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.155 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.156 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.157 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.158 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.159 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.160 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:04.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.199 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.200 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: pgmap v108: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 150 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.201 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.202 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.203 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.204 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: pgmap v108: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 150 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.205 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.206 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.207 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: pgmap v108: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 150 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:05.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:05.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:05.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.094 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:05] "GET /metrics HTTP/1.1" 200 38575 "" "Prometheus/2.43.0" 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.095 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.096 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.099 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.114 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.116 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.117 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.118 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: pgmap v109: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.862 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.863 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: pgmap v109: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:06.864 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.865 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.866 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:06.867 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:06.868 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: pgmap v109: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 125 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:07.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:07.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:07.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:07.454 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:07.157+0000 7f1c23f6b640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-20T23:26:07.454 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:07.180+0000 7f1c23f6b640 -1 osd.1 125 log_to_monitors true 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.048 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:08.049 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.050 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.051 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.052 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.056 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:08.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:08.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:08.308 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:08.108+0000 7f1c1bd16640 -1 osd.1 125 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: osdmap e128: 8 total, 7 up, 8 in 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: pgmap v111: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: osdmap e128: 8 total, 7 up, 8 in 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: pgmap v111: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:09.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: osdmap e128: 8 total, 7 up, 8 in 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: pgmap v111: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 0 B/s wr, 139 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148] boot 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: osdmap e129: 8 total, 8 up, 8 in 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148] boot 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: osdmap e129: 8 total, 8 up, 8 in 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:09.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: osd.1 [v2:172.21.15.170:6808/3355262148,v1:172.21.15.170:6809/3355262148] boot 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: osdmap e129: 8 total, 8 up, 8 in 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.845 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: osdmap e130: 8 total, 8 up, 8 in 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:10.846 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:10.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:10.847 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: pgmap v114: 161 pgs: 36 peering, 19 active+undersized, 8 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s; 37/630 objects degraded (5.873%) 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: osdmap e130: 8 total, 8 up, 8 in 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: pgmap v114: 161 pgs: 36 peering, 19 active+undersized, 8 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s; 37/630 objects degraded (5.873%) 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.168 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: osdmap e130: 8 total, 8 up, 8 in 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: pgmap v114: 161 pgs: 36 peering, 19 active+undersized, 8 active+undersized+degraded, 98 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s; 37/630 objects degraded (5.873%) 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.866 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.867 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 37/630 objects degraded (5.873%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.869 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.870 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 37/630 objects degraded (5.873%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.871 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.872 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.873 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.874 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:11.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 37/630 objects degraded (5.873%), 8 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:12.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:12.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.119 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: pgmap v115: 161 pgs: 36 peering, 14 active+undersized, 7 active+undersized+degraded, 104 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/630 objects degraded (4.921%); 0 B/s, 0 objects/s recovering 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.121 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.122 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: pgmap v115: 161 pgs: 36 peering, 14 active+undersized, 7 active+undersized+degraded, 104 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/630 objects degraded (4.921%); 0 B/s, 0 objects/s recovering 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.123 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.125 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.126 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.127 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:26:12.918+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (36 PGs are or would become offline) 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: pgmap v115: 161 pgs: 36 peering, 14 active+undersized, 7 active+undersized+degraded, 104 active+clean; 585 KiB data, 140 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/630 objects degraded (4.921%); 0 B/s, 0 objects/s recovering 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (36 PGs are or would become offline) 2024-09-20T23:26:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.232 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (36 PGs are or would become offline) 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:14.233 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (36 PGs are or would become offline) 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:14.234 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:14 smithi191 ceph-mon[95499]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 9 objects/s recovering 2024-09-20T23:26:15.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:14 smithi170 ceph-mon[111392]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 9 objects/s recovering 2024-09-20T23:26:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:14 smithi170 ceph-mon[99281]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 9 objects/s recovering 2024-09-20T23:26:15.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:15 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/630 objects degraded (4.921%), 7 pgs degraded) 2024-09-20T23:26:15.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:15 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:26:15.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:15 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/630 objects degraded (4.921%), 7 pgs degraded) 2024-09-20T23:26:15.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:15 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:26:16.128 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:15] "GET /metrics HTTP/1.1" 200 38590 "" "Prometheus/2.43.0" 2024-09-20T23:26:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:15 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/630 objects degraded (4.921%), 7 pgs degraded) 2024-09-20T23:26:16.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:15 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:26:16.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:16 smithi170 ceph-mon[99281]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 7 objects/s recovering 2024-09-20T23:26:16.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:16 smithi170 ceph-mon[111392]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 7 objects/s recovering 2024-09-20T23:26:17.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:16 smithi191 ceph-mon[95499]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 7 objects/s recovering 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[99281]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 6 objects/s recovering 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:18 smithi170 ceph-mon[111392]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 6 objects/s recovering 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:18 smithi191 ceph-mon[95499]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 6 objects/s recovering 2024-09-20T23:26:20.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:20 smithi191 ceph-mon[95499]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s; 0 B/s, 5 objects/s recovering 2024-09-20T23:26:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:20 smithi170 ceph-mon[99281]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s; 0 B/s, 5 objects/s recovering 2024-09-20T23:26:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:20 smithi170 ceph-mon[111392]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s; 0 B/s, 5 objects/s recovering 2024-09-20T23:26:22.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:22 smithi191 ceph-mon[95499]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:22 smithi170 ceph-mon[111392]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:22 smithi170 ceph-mon[99281]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:24.077 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[99281]: from='client.54300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[99281]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[111392]: from='client.54300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:24 smithi170 ceph-mon[111392]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:24.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:24 smithi191 ceph-mon[95499]: from='client.54300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:24.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:24 smithi191 ceph-mon[95499]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 4 objects/s recovering 2024-09-20T23:26:24.739 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:26:24.739 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 7s ago 17m - - 2024-09-20T23:26:24.739 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 13s ago 16m - - 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (6m) 7s ago 11m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (5m) 13s ago 11m 52.4M - dad864ee21e9 db20e8680365 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (5m) 7s ago 10m 56.1M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (5m) 13s ago 16m 515M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (3m) 7s ago 17m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (3m) 7s ago 18m 57.2M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (111s) 13s ago 16m 36.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (2m) 7s ago 16m 45.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (6m) 7s ago 12m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (6m) 13s ago 12m 15.7M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (50s) 7s ago 15m 47.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:26:24.740 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (23s) 7s ago 15m 44.3M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 0e943ec2d494 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (15m) 7s ago 15m 53.6M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (14m) 7s ago 14m 58.1M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (14m) 13s ago 14m 59.0M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (14m) 13s ago 13m 59.5M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (13m) 13s ago 13m 55.6M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (13m) 13s ago 13m 58.6M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (5m) 13s ago 12m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (10m) 7s ago 10m 73.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (10m) 13s ago 10m 75.3M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (10m) 7s ago 10m 74.0M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:26:24.741 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (10m) 13s ago 10m 73.2M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-20T23:26:25.134 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 7 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:26:25.135 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:26:25.468 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:26:25.469 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "7/23 daemons upgraded", 2024-09-20T23:26:25.469 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:26:25.469 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:26:25.469 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[99281]: from='client.54306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[99281]: from='client.54312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/967658379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[111392]: from='client.54306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[111392]: from='client.54312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:25 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/967658379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:25 smithi191 ceph-mon[95499]: from='client.54306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:25 smithi191 ceph-mon[95499]: from='client.54312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:25 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/967658379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:25.863 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:26:26.162 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:25] "GET /metrics HTTP/1.1" 200 38590 "" "Prometheus/2.43.0" 2024-09-20T23:26:26.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:26 smithi191 ceph-mon[95499]: from='client.54324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:26.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:26 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3303970991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:26.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:26 smithi191 ceph-mon[95499]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[99281]: from='client.54324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3303970991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[99281]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[111392]: from='client.54324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3303970991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:26.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:26 smithi170 ceph-mon[111392]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:28.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:28.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:28.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:29 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:29 smithi191 ceph-mon[95499]: Upgrade: osd.1 is safe to restart 2024-09-20T23:26:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:29 smithi191 ceph-mon[95499]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[99281]: Upgrade: osd.1 is safe to restart 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[99281]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[111392]: Upgrade: osd.1 is safe to restart 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[111392]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:26:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:26:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T23:26:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:31.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[99281]: Upgrade: Updating osd.1 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[99281]: Deploying daemon osd.1 on smithi170 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[99281]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[111392]: Upgrade: Updating osd.1 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[111392]: Deploying daemon osd.1 on smithi170 2024-09-20T23:26:31.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:31 smithi170 ceph-mon[111392]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:26:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:31 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:31 smithi191 ceph-mon[95499]: Upgrade: Updating osd.1 2024-09-20T23:26:31.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:31 smithi191 ceph-mon[95499]: Deploying daemon osd.1 on smithi170 2024-09-20T23:26:31.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:31 smithi191 ceph-mon[95499]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:26:32.605 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:32 smithi170 systemd[1]: Stopping Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:26:32.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[99281]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:32.888 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:32.711+0000 7f1c20f03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:26:32.889 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:32.711+0000 7f1c20f03640 -1 osd.1 130 *** Got signal Terminated *** 2024-09-20T23:26:32.889 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[129038]: 2024-09-20T23:26:32.711+0000 7f1c20f03640 -1 osd.1 130 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:26:32.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:32 smithi170 ceph-mon[111392]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:32.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:32 smithi191 ceph-mon[95499]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:26:33.954 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:33 smithi170 ceph-mon[99281]: osd.1 marked itself down and dead 2024-09-20T23:26:33.954 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:33 smithi170 ceph-mon[111392]: osd.1 marked itself down and dead 2024-09-20T23:26:33.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:33 smithi191 ceph-mon[95499]: osd.1 marked itself down and dead 2024-09-20T23:26:34.243 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:33 smithi170 podman[134290]: 2024-09-20 23:26:33.952742754 +0000 UTC m=+1.372256007 container died 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:26:34.619 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:34 smithi170 podman[134290]: 2024-09-20 23:26:34.416324548 +0000 UTC m=+1.835837797 container cleanup 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-20T23:26:34.619 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:34 smithi170 bash[134290]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1 2024-09-20T23:26:34.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:34 smithi170 podman[134536]: 2024-09-20 23:26:34.701167399 +0000 UTC m=+0.751446227 container remove 0e943ec2d4943a6597c15c233bb1d0b363c309f1c89a48c130deb77362eb6df9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T23:26:34.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:26:34.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[99281]: osdmap e131: 8 total, 7 up, 8 in 2024-09-20T23:26:34.956 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[99281]: pgmap v127: 161 pgs: 56 peering, 1 stale+active+clean, 104 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:26:34.956 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:26:34.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[111392]: osdmap e131: 8 total, 7 up, 8 in 2024-09-20T23:26:34.957 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:34 smithi170 ceph-mon[111392]: pgmap v127: 161 pgs: 56 peering, 1 stale+active+clean, 104 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:26:34.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:34 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:26:34.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:34 smithi191 ceph-mon[95499]: osdmap e131: 8 total, 7 up, 8 in 2024-09-20T23:26:34.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:34 smithi191 ceph-mon[95499]: pgmap v127: 161 pgs: 56 peering, 1 stale+active+clean, 104 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:26:35.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:35 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-20T23:26:35.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:35 smithi191 ceph-mon[95499]: osdmap e132: 8 total, 7 up, 8 in 2024-09-20T23:26:35.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:35 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-20T23:26:35.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:35 smithi170 ceph-mon[99281]: osdmap e132: 8 total, 7 up, 8 in 2024-09-20T23:26:35.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:35 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-20T23:26:35.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:35 smithi170 ceph-mon[111392]: osdmap e132: 8 total, 7 up, 8 in 2024-09-20T23:26:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:35] "GET /metrics HTTP/1.1" 200 38589 "" "Prometheus/2.43.0" 2024-09-20T23:26:36.330 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:35.941218782 +0000 UTC m=+0.019218184 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:26:36.330 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:36.109194751 +0000 UTC m=+0.187194187 container create f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD) 2024-09-20T23:26:36.625 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:36.328612471 +0000 UTC m=+0.406611870 container init f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0) 2024-09-20T23:26:36.625 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:36.332322255 +0000 UTC m=+0.410321650 container start f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70) 2024-09-20T23:26:36.625 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:36.411805349 +0000 UTC m=+0.489804751 container attach f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-20T23:26:36.625 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:36 smithi170 podman[134703]: 2024-09-20 23:26:36.54216457 +0000 UTC m=+0.620163976 container died f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-20T23:26:36.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:36 smithi191 ceph-mon[95499]: pgmap v129: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:36.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:36 smithi170 ceph-mon[99281]: pgmap v129: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:36.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:36 smithi170 ceph-mon[111392]: pgmap v129: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:37.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:37 smithi170 podman[134751]: 2024-09-20 23:26:37.215876846 +0000 UTC m=+0.667883898 container remove f535373c4a2b9b4c45c9d2683f5619ad49e31fd8a99efa4b16de6a9329db9079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2) 2024-09-20T23:26:37.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:37 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-20T23:26:37.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:37 smithi170 systemd[1]: Stopped Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:26:37.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:37 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service: Consumed 1.908s CPU time. 2024-09-20T23:26:37.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:37 smithi170 systemd[1]: Starting Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:26:37.868 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:37 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 6/630 objects degraded (0.952%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:26:37.868 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:37 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 6/630 objects degraded (0.952%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:26:37.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:37 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 6/630 objects degraded (0.952%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:26:39.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[99281]: pgmap v130: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:39.111 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:38 smithi170 podman[135031]: 2024-09-20 23:26:38.739546349 +0000 UTC m=+0.018220919 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:26:39.111 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:38 smithi170 podman[135031]: 2024-09-20 23:26:38.857109912 +0000 UTC m=+0.135784477 container create bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:26:39.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:38 smithi170 ceph-mon[111392]: pgmap v130: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:38 smithi191 ceph-mon[95499]: pgmap v130: 161 pgs: 6 active+undersized, 56 peering, 1 active+undersized+degraded, 98 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 podman[135031]: 2024-09-20 23:26:39.109863814 +0000 UTC m=+0.388538381 container init bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-9e2ac70) 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 podman[135031]: 2024-09-20 23:26:39.11370077 +0000 UTC m=+0.392375327 container start bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 podman[135031]: 2024-09-20 23:26:39.218225524 +0000 UTC m=+0.496900090 container attach bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 bash[135031]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:26:39.446 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:39 smithi170 bash[135031]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:26:40.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:40.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[99281]: pgmap v131: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:40.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-20T23:26:40.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:40.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[111392]: pgmap v131: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:40.612 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-20T23:26:40.612 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:40.612 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:40.613 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:40.613 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:40.613 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:40.613 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:26:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:40 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:40 smithi191 ceph-mon[95499]: pgmap v131: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:40 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate[135066]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 bash[135031]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-20T23:26:40.955 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:40 smithi170 podman[135031]: 2024-09-20 23:26:40.692795853 +0000 UTC m=+1.971470435 container died bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:26:41.739 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:41 smithi170 podman[135333]: 2024-09-20 23:26:41.354860597 +0000 UTC m=+0.707997415 container remove bd231f7d37e8ec3cdf12eaeff05d6ba98a3a8c073d6061de6cc4bd4ef69942ae (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-20T23:26:42.454 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 podman[135435]: 2024-09-20 23:26:42.101302415 +0000 UTC m=+0.017299624 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:26:42.454 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 podman[135435]: 2024-09-20 23:26:42.208862739 +0000 UTC m=+0.124859932 container create e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:26:42.454 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 podman[135435]: 2024-09-20 23:26:42.452985948 +0000 UTC m=+0.368983162 container init e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-20T23:26:42.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 podman[135435]: 2024-09-20 23:26:42.456461296 +0000 UTC m=+0.372458490 container start e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-20T23:26:42.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 ceph-osd[135467]: -- 172.21.15.170:0/265922057 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563032215a40 con 0x563032fdc400 2024-09-20T23:26:42.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 bash[135435]: e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 2024-09-20T23:26:42.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:42 smithi170 systemd[1]: Started Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: pgmap v132: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: pgmap v132: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: pgmap v132: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.350 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: pgmap v133: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:44.350 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.350 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.351 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.352 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: pgmap v133: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.353 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.357 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.358 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: pgmap v133: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:44.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:44.606 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:26:44.346+0000 7f8ccc3ff640 -1 Falling back to public interface 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.210 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:45] "GET /metrics HTTP/1.1" 200 38594 "" "Prometheus/2.43.0" 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: pgmap v134: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: pgmap v134: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: pgmap v134: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 87/630 objects degraded (13.810%), 24 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.210 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:47 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:26:47.916+0000 7f8ccc3ff640 -1 osd.1 130 log_to_monitors true 2024-09-20T23:26:48.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: pgmap v135: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.298 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.301 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.302 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: pgmap v135: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: pgmap v135: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:48.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:48.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.196 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:26:48 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:26:48.869+0000 7f8cc41aa640 -1 osd.1 130 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:26:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: osdmap e133: 8 total, 7 up, 8 in 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: osdmap e133: 8 total, 7 up, 8 in 2024-09-20T23:26:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T23:26:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: osdmap e133: 8 total, 7 up, 8 in 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: pgmap v136: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.326 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.327 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: pgmap v136: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:50.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398] boot 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: osdmap e134: 8 total, 8 up, 8 in 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398] boot 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: osdmap e134: 8 total, 8 up, 8 in 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: pgmap v136: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 981 B/s rd, 0 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: osd.1 [v2:172.21.15.170:6808/1579220398,v1:172.21.15.170:6809/1579220398] boot 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: osdmap e134: 8 total, 8 up, 8 in 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:50.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: osdmap e135: 8 total, 8 up, 8 in 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: osdmap e135: 8 total, 8 up, 8 in 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: osdmap e135: 8 total, 8 up, 8 in 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:51.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.216 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: pgmap v139: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: pgmap v139: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: pgmap v139: 161 pgs: 39 active+undersized, 24 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 87/630 objects degraded (13.810%) 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: pgmap v141: 161 pgs: 6 peering, 34 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.440 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.441 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: pgmap v141: 161 pgs: 6 peering, 34 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.442 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.444 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.445 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.448 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: pgmap v141: 161 pgs: 6 peering, 34 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 146 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:54.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:55.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:55.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:55.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:55.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:55 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.221 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:26:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:26:55] "GET /metrics HTTP/1.1" 200 38594 "" "Prometheus/2.43.0" 2024-09-20T23:26:56.242 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: pgmap v142: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded) 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: pgmap v142: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded) 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: pgmap v142: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 81/630 objects degraded (12.857%), 23 pgs degraded) 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:56.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 14s ago 17m - - 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 5s ago 17m - - 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (7m) 14s ago 12m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (6m) 5s ago 12m 52.1M - dad864ee21e9 db20e8680365 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (5m) 14s ago 10m 56.2M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (5m) 5s ago 16m 517M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (4m) 14s ago 18m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:26:56.937 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (3m) 14s ago 18m 57.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (2m) 5s ago 17m 37.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (2m) 14s ago 17m 45.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (7m) 14s ago 12m 16.7M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (6m) 5s ago 12m 15.4M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (82s) 14s ago 16m 48.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 starting - - - 4096M 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (15m) 14s ago 15m 53.6M 4096M 17.2.0 e1d6a67b021e ffe8e45de472 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (15m) 14s ago 15m 58.1M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (14m) 5s ago 14m 60.8M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:26:56.938 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (14m) 5s ago 14m 60.1M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (14m) 5s ago 14m 56.9M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (13m) 5s ago 13m 59.7M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (5m) 5s ago 13m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (11m) 14s ago 11m 73.0M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (11m) 5s ago 11m 75.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (10m) 14s ago 10m 74.1M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:26:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (10m) 5s ago 10m 73.4M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:26:57.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 7 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:26:57.366 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='client.54342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='client.54342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='client.54342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:57.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:26:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:26:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "6/23 daemons upgraded", 2024-09-20T23:26:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:26:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:26:57.720 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:26:58.139 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='client.54348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.424 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='client.74317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2938051370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.425 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='client.54348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='client.74317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2938051370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.429 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/407846771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:58.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/407846771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='client.54348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='client.74317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/2938051370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/407846771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:58.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:26:59.362 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='client.74329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.363 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.364 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='client.74329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.367 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.368 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.369 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.370 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.371 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.371 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.371 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:26:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:26:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='client.74329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:59.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:26:59.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:26:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:00.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:00.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:01.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:01.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:01.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:01 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:01.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[99281]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[99281]: Upgrade: Updating osd.2 2024-09-20T23:27:02.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[99281]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[111392]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[111392]: Upgrade: Updating osd.2 2024-09-20T23:27:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:02 smithi170 ceph-mon[111392]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:02.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:02 smithi191 ceph-mon[95499]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:02.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:02 smithi191 ceph-mon[95499]: Upgrade: Updating osd.2 2024-09-20T23:27:02.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:02 smithi191 ceph-mon[95499]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:04.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:04 smithi170 ceph-mon[99281]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-09-20T23:27:04.441 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:04.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:04 smithi170 ceph-mon[111392]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-09-20T23:27:04.442 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:04.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:04 smithi191 ceph-mon[95499]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-09-20T23:27:04.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:05.418 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:05 smithi170 systemd[1]: Stopping Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:27:05.418 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:05 smithi170 ceph-mon[111392]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:05.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:05 smithi170 ceph-mon[99281]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:05.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:05 smithi191 ceph-mon[95499]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:05.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[37738]: 2024-09-20T23:27:05.417+0000 7fc4d7834700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:27:05.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[37738]: 2024-09-20T23:27:05.417+0000 7fc4d7834700 -1 osd.2 135 *** Got signal Terminated *** 2024-09-20T23:27:05.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:05 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[37738]: 2024-09-20T23:27:05.417+0000 7fc4d7834700 -1 osd.2 135 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:27:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:05] "GET /metrics HTTP/1.1" 200 38587 "" "Prometheus/2.43.0" 2024-09-20T23:27:06.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:06 smithi191 ceph-mon[95499]: osd.2 marked itself down and dead 2024-09-20T23:27:06.715 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:06 smithi170 ceph-mon[99281]: osd.2 marked itself down and dead 2024-09-20T23:27:06.715 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:06 smithi170 ceph-mon[111392]: osd.2 marked itself down and dead 2024-09-20T23:27:06.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:06 smithi170 podman[142454]: 2024-09-20 23:27:06.713003373 +0000 UTC m=+1.406073104 container died ffe8e45de472e1812e1ff163cf9598aa71714aaa899758aa99629a4b7beca696 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., GIT_CLEAN=True, architecture=x86_64, ceph=True, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, io.openshift.expose-services=, GIT_BRANCH=HEAD, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, release=754, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:27:07.433 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:07 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:07.433 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:07 smithi191 ceph-mon[95499]: osdmap e136: 8 total, 7 up, 8 in 2024-09-20T23:27:07.433 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:07 smithi191 ceph-mon[95499]: pgmap v149: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:07.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:07.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[99281]: osdmap e136: 8 total, 7 up, 8 in 2024-09-20T23:27:07.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[99281]: pgmap v149: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:07.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:07.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[111392]: osdmap e136: 8 total, 7 up, 8 in 2024-09-20T23:27:07.479 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:07 smithi170 ceph-mon[111392]: pgmap v149: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:07.479 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:07 smithi170 podman[142454]: 2024-09-20 23:27:07.209159736 +0000 UTC m=+1.902229457 container cleanup ffe8e45de472e1812e1ff163cf9598aa71714aaa899758aa99629a4b7beca696 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.19.8, RELEASE=HEAD, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, io.openshift.expose-services=, distribution-scope=public, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, version=8, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-09-20T23:27:07.479 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:07 smithi170 bash[142454]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2 2024-09-20T23:27:07.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:07 smithi170 podman[142471]: 2024-09-20 23:27:07.477250354 +0000 UTC m=+0.760711288 container remove ffe8e45de472e1812e1ff163cf9598aa71714aaa899758aa99629a4b7beca696 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, vendor=Red Hat, Inc., vcs-type=git, ceph=True, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, version=8, maintainer=Guillaume Abrioux , distribution-scope=public, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream) 2024-09-20T23:27:08.073 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:07 smithi170 podman[142556]: 2024-09-20 23:27:07.690170468 +0000 UTC m=+0.015900527 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:08.090 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:07 smithi170 podman[142556]: 2024-09-20 23:27:07.836608948 +0000 UTC m=+0.162339044 container create 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-20T23:27:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:08 smithi191 ceph-mon[95499]: osdmap e137: 8 total, 7 up, 8 in 2024-09-20T23:27:08.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:08 smithi170 ceph-mon[99281]: osdmap e137: 8 total, 7 up, 8 in 2024-09-20T23:27:08.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:08 smithi170 ceph-mon[111392]: osdmap e137: 8 total, 7 up, 8 in 2024-09-20T23:27:08.494 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 podman[142556]: 2024-09-20 23:27:08.072558035 +0000 UTC m=+0.398288095 container init 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-20T23:27:08.494 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 podman[142556]: 2024-09-20 23:27:08.077535874 +0000 UTC m=+0.403265925 container start 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-20T23:27:08.494 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 podman[142556]: 2024-09-20 23:27:08.172695001 +0000 UTC m=+0.498425058 container attach 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-20T23:27:08.495 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 podman[142556]: 2024-09-20 23:27:08.275032713 +0000 UTC m=+0.600762770 container died 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-20T23:27:09.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 podman[142579]: 2024-09-20 23:27:08.84305681 +0000 UTC m=+0.562079538 container remove 59a52eb5688fa292331a137ef41c953a9e3f5becdd8506db01df029479a10991 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:27:09.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-20T23:27:09.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 systemd[1]: Stopped Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:27:09.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:08 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service: Consumed 7.680s CPU time. 2024-09-20T23:27:09.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 systemd[1]: Starting Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:27:09.523 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:09 smithi170 ceph-mon[99281]: pgmap v151: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:09.523 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:09 smithi170 ceph-mon[111392]: pgmap v151: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:09.523 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 podman[142676]: 2024-09-20 23:27:09.188111522 +0000 UTC m=+0.015928792 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:09.523 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 podman[142676]: 2024-09-20 23:27:09.294522101 +0000 UTC m=+0.122339359 container create 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2) 2024-09-20T23:27:09.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:09 smithi191 ceph-mon[95499]: pgmap v151: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:09.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 podman[142676]: 2024-09-20 23:27:09.522091957 +0000 UTC m=+0.349909225 container init 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T23:27:09.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 podman[142676]: 2024-09-20 23:27:09.525351352 +0000 UTC m=+0.353168619 container start 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-20T23:27:09.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 podman[142676]: 2024-09-20 23:27:09.614033658 +0000 UTC m=+0.441850921 container attach 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70) 2024-09-20T23:27:09.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:09.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 bash[142676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:09.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:09.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:09 smithi170 bash[142676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:10.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:10 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:10.731 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:10.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:10.732 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:10.732 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:10.732 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:10.732 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T23:27:10.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:10.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:10.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[142692]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-20T23:27:10.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 bash[142676]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-20T23:27:10.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:10 smithi170 podman[142676]: 2024-09-20 23:27:10.76011276 +0000 UTC m=+1.587930026 container died 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:27:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:11 smithi170 ceph-mon[99281]: pgmap v152: 161 pgs: 29 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 48/630 objects degraded (7.619%) 2024-09-20T23:27:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:11 smithi170 ceph-mon[111392]: pgmap v152: 161 pgs: 29 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 48/630 objects degraded (7.619%) 2024-09-20T23:27:11.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:11 smithi191 ceph-mon[95499]: pgmap v152: 161 pgs: 29 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 48/630 objects degraded (7.619%) 2024-09-20T23:27:11.963 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:11 smithi170 podman[142832]: 2024-09-20 23:27:11.610263195 +0000 UTC m=+0.842566270 container remove 79c6d418a29c74db0dfcd5288b59550a9ac2defb1fafdee796ff6f5572243741 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:27:11.963 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:11 smithi170 podman[142892]: 2024-09-20 23:27:11.725833806 +0000 UTC m=+0.016158863 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:11.963 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:11 smithi170 podman[142892]: 2024-09-20 23:27:11.836173502 +0000 UTC m=+0.126498587 container create 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:27:12.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:12 smithi170 podman[142892]: 2024-09-20 23:27:12.071807562 +0000 UTC m=+0.362132613 container init 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T23:27:12.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:12 smithi170 podman[142892]: 2024-09-20 23:27:12.075164086 +0000 UTC m=+0.365489128 container start 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:27:12.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-osd[142911]: -- 172.21.15.170:0/4008393594 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56479592ba40 con 0x564795909c00 2024-09-20T23:27:12.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:12 smithi170 bash[142892]: 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc 2024-09-20T23:27:12.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:12 smithi170 systemd[1]: Started Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:12.525 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:12.526 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.316 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: pgmap v153: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.318 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: pgmap v153: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:13.319 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.320 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.321 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.323 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: pgmap v153: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:13.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:13.980+0000 7f022a7bb640 -1 Falling back to public interface 2024-09-20T23:27:14.542 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.544 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.545 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.546 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.547 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.548 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.549 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.550 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.550 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.550 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.550 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:14.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:14.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:14.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:14.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:14.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: pgmap v154: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: pgmap v154: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: pgmap v154: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:15] "GET /metrics HTTP/1.1" 200 38590 "" "Prometheus/2.43.0" 2024-09-20T23:27:16.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.626 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.627 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.628 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:16.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.526 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:17.271+0000 7f022a7bb640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-20T23:27:17.526 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:17.294+0000 7f022a7bb640 -1 osd.2 135 log_to_monitors true 2024-09-20T23:27:17.526 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.527 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.528 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: pgmap v155: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:17.529 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.530 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: pgmap v155: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.532 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.533 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.534 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.536 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.537 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.538 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.538 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.538 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: pgmap v155: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:17.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:17.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:17.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:17.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:17.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:18.311+0000 7f0222566640 -1 osd.2 135 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:18.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.594 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: osdmap e138: 8 total, 7 up, 8 in 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.595 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: pgmap v157: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.596 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: osdmap e138: 8 total, 7 up, 8 in 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.597 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.598 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: pgmap v157: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.599 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.600 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.601 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.602 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.603 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.604 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: osdmap e138: 8 total, 7 up, 8 in 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: pgmap v157: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:19.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811] boot 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: osdmap e139: 8 total, 8 up, 8 in 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[111392]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811] boot 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: osdmap e139: 8 total, 8 up, 8 in 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:20 smithi170 ceph-mon[99281]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: osd.2 [v2:172.21.15.170:6816/73088811,v1:172.21.15.170:6817/73088811] boot 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: osdmap e139: 8 total, 8 up, 8 in 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T23:27:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:20 smithi191 ceph-mon[95499]: Upgrade: osd.2 is safe to restart 2024-09-20T23:27:21.534 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[99281]: osdmap e140: 8 total, 8 up, 8 in 2024-09-20T23:27:21.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:21.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[99281]: pgmap v160: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:21.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[111392]: osdmap e140: 8 total, 8 up, 8 in 2024-09-20T23:27:21.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:21.535 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:21 smithi170 ceph-mon[111392]: pgmap v160: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:21 smithi191 ceph-mon[95499]: osdmap e140: 8 total, 8 up, 8 in 2024-09-20T23:27:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:21 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:21.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:21 smithi191 ceph-mon[95499]: pgmap v160: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:23.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[99281]: pgmap v161: 161 pgs: 31 active+undersized, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:23.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[99281]: Upgrade: Updating osd.2 2024-09-20T23:27:23.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:23.860 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[99281]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[111392]: pgmap v161: 161 pgs: 31 active+undersized, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[111392]: Upgrade: Updating osd.2 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:23.861 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:23 smithi170 ceph-mon[111392]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:23.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:23 smithi191 ceph-mon[95499]: pgmap v161: 161 pgs: 31 active+undersized, 10 active+undersized+degraded, 120 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:23.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:23 smithi191 ceph-mon[95499]: Upgrade: Updating osd.2 2024-09-20T23:27:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T23:27:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:23 smithi191 ceph-mon[95499]: Deploying daemon osd.2 on smithi170 2024-09-20T23:27:25.181 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:24 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded) 2024-09-20T23:27:25.181 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:24 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:27:25.181 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:25.182 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded) 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded) 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:27:25.192 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:25.193 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:26.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:25 smithi170 ceph-mon[99281]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:27:26.039 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:26.039 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:25 smithi170 ceph-mon[111392]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:27:26.040 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:26.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:25 smithi191 ceph-mon[95499]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:27:26.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:26.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:25] "GET /metrics HTTP/1.1" 200 38590 "" "Prometheus/2.43.0" 2024-09-20T23:27:28.124 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:28 smithi191 ceph-mon[95499]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:28.124 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.124 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.124 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.143 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[111392]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[99281]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.144 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:28.506 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:27:29.215 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:27:29.215 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 2s ago 18m - - 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 17s ago 18m - - 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (7m) 2s ago 12m 27.1M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (7m) 17s ago 12m 51.8M - dad864ee21e9 db20e8680365 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (6m) 2s ago 11m 60.4M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (6m) 17s ago 17m 518M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (5m) 2s ago 19m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (4m) 2s ago 19m 62.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (2m) 17s ago 17m 42.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (3m) 2s ago 17m 51.2M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (7m) 2s ago 13m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (7m) 17s ago 13m 15.7M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (115s) 2s ago 17m 49.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:27:29.216 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (47s) 2s ago 16m 46.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (17s) 2s ago 16m 42.7M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 910fe09c618c 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (15m) 2s ago 15m 59.8M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (15m) 17s ago 15m 61.0M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (15m) 17s ago 15m 61.4M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (14m) 17s ago 14m 56.6M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (14m) 17s ago 14m 59.5M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (6m) 17s ago 13m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (11m) 2s ago 11m 73.2M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (11m) 17s ago 11m 75.6M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (11m) 2s ago 11m 74.4M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:27:29.217 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (11m) 17s ago 11m 73.4M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:27:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:29.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:29 smithi170 systemd[1]: Stopping Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:27:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:29.659 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:27:29.659 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:27:29.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-09-20T23:27:29.661 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:27:29.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:27:29.661 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:27:29.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:29.584+0000 7f0227753640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:27:29.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:29.584+0000 7f0227753640 -1 osd.2 140 *** Got signal Terminated *** 2024-09-20T23:27:29.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:29 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[142907]: 2024-09-20T23:27:29.584+0000 7f0227753640 -1 osd.2 140 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:27:30.003 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:27:30.003 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:27:30.003 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "8/23 daemons upgraded", 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:27:30.004 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:27:30.415 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 osds down 2024-09-20T23:27:30.416 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T23:27:30.416 INFO:teuthology.orchestra.run.smithi170.stdout: osd.2 (root=default,host=smithi170) is down 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: from='client.74347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: from='client.54390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: osd.2 marked itself down and dead 2024-09-20T23:27:30.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/726639330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: from='client.74347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: from='client.54390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: osd.2 marked itself down and dead 2024-09-20T23:27:30.417 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:30 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/726639330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:30.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: from='client.74347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-09-20T23:27:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: from='client.54390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: osd.2 marked itself down and dead 2024-09-20T23:27:30.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:30 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/726639330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:30.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:30 smithi170 podman[147035]: 2024-09-20 23:27:30.572092098 +0000 UTC m=+1.116420143 container died 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-20T23:27:31.235 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147035]: 2024-09-20 23:27:31.026504252 +0000 UTC m=+1.570832296 container cleanup 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:27:31.235 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 bash[147035]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2 2024-09-20T23:27:31.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147099]: 2024-09-20 23:27:31.361665419 +0000 UTC m=+0.785844683 container remove 910fe09c618c19e0f5fdccef88bff7ce4f8cba38fabeb8ce7a91c11887b9ebdc (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: from='client.74371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: osdmap e141: 8 total, 7 up, 8 in 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/4050008760' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:27:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[111392]: osdmap e142: 8 total, 7 up, 8 in 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: from='client.74371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: osdmap e141: 8 total, 7 up, 8 in 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/4050008760' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:27:31.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:31 smithi170 ceph-mon[99281]: osdmap e142: 8 total, 7 up, 8 in 2024-09-20T23:27:31.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: from='client.74371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:27:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: osdmap e141: 8 total, 7 up, 8 in 2024-09-20T23:27:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/4050008760' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:27:31.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:31 smithi191 ceph-mon[95499]: osdmap e142: 8 total, 7 up, 8 in 2024-09-20T23:27:31.949 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147186]: 2024-09-20 23:27:31.588816448 +0000 UTC m=+0.016128371 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:31.950 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147186]: 2024-09-20 23:27:31.704029773 +0000 UTC m=+0.131341699 container create feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:27:32.236 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147186]: 2024-09-20 23:27:31.948537743 +0000 UTC m=+0.375849674 container init feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-20T23:27:32.237 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:31 smithi170 podman[147186]: 2024-09-20 23:27:31.952761871 +0000 UTC m=+0.380073794 container start feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-20T23:27:32.237 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 podman[147186]: 2024-09-20 23:27:32.056956946 +0000 UTC m=+0.484268881 container attach feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T23:27:32.237 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 podman[147186]: 2024-09-20 23:27:32.138703905 +0000 UTC m=+0.566015838 container died feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-20T23:27:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:32 smithi191 ceph-mon[95499]: pgmap v166: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[99281]: pgmap v166: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[111392]: pgmap v166: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:33.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 podman[147210]: 2024-09-20 23:27:32.944302132 +0000 UTC m=+0.799779442 container remove feb3e39ab793db5286c7f520e8d5dfb42c095e777491655d808a16c14ddac880 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-20T23:27:33.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-20T23:27:33.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 systemd[1]: Stopped Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:27:33.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:32 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service: Consumed 1.703s CPU time. 2024-09-20T23:27:33.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 systemd[1]: Starting Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:27:33.675 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 podman[147308]: 2024-09-20 23:27:33.305234354 +0000 UTC m=+0.015800999 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:33.675 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 podman[147308]: 2024-09-20 23:27:33.429096629 +0000 UTC m=+0.139663304 container create c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-20T23:27:33.675 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 podman[147308]: 2024-09-20 23:27:33.673891335 +0000 UTC m=+0.384457978 container init c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-20T23:27:33.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 podman[147308]: 2024-09-20 23:27:33.677660104 +0000 UTC m=+0.388226746 container start c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70) 2024-09-20T23:27:33.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 podman[147308]: 2024-09-20 23:27:33.748421887 +0000 UTC m=+0.458988538 container attach c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-20T23:27:33.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:33.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 bash[147308]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:33.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:33.994 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:33 smithi170 bash[147308]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:27:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-mon[99281]: pgmap v168: 161 pgs: 5 peering, 12 stale+active+clean, 144 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-mon[111392]: pgmap v168: 161 pgs: 5 peering, 12 stale+active+clean, 144 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:34.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:34 smithi191 ceph-mon[95499]: pgmap v168: 161 pgs: 5 peering, 12 stale+active+clean, 144 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:27:34.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:34.867 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:34.867 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:34.867 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:34.867 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T23:27:35.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:35.244 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T23:27:35.244 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate[147323]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-20T23:27:35.244 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 bash[147308]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-20T23:27:35.244 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:34 smithi170 podman[147308]: 2024-09-20 23:27:34.895016275 +0000 UTC m=+1.605582908 container died c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:27:35.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:35 smithi170 ceph-mon[99281]: pgmap v169: 161 pgs: 29 active+undersized, 5 peering, 2 stale+active+clean, 10 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:35.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:35 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:35.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:35 smithi170 ceph-mon[111392]: pgmap v169: 161 pgs: 29 active+undersized, 5 peering, 2 stale+active+clean, 10 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:35.654 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:35 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:35.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:35 smithi191 ceph-mon[95499]: pgmap v169: 161 pgs: 29 active+undersized, 5 peering, 2 stale+active+clean, 10 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:27:35.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:35 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 48/630 objects degraded (7.619%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:35.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:35 smithi170 podman[147454]: 2024-09-20 23:27:35.652524945 +0000 UTC m=+0.747596214 container remove c630a93284c4c1a9c29bf88e3b4e1df0a80a10bb5e83db1273ad3d8ceb242c94 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-20T23:27:35.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:35 smithi170 podman[147513]: 2024-09-20 23:27:35.765575767 +0000 UTC m=+0.015975267 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:27:35.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:35 smithi170 podman[147513]: 2024-09-20 23:27:35.878363234 +0000 UTC m=+0.128762760 container create 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:27:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:35] "GET /metrics HTTP/1.1" 200 38603 "" "Prometheus/2.43.0" 2024-09-20T23:27:36.373 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:36 smithi170 podman[147513]: 2024-09-20 23:27:36.114319244 +0000 UTC m=+0.364718735 container init 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:27:36.373 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:36 smithi170 podman[147513]: 2024-09-20 23:27:36.117767144 +0000 UTC m=+0.368166627 container start 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-20T23:27:36.373 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:36 smithi170 ceph-osd[147532]: -- 172.21.15.170:0/3645474968 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d915273a40 con 0x55d91603a400 2024-09-20T23:27:36.373 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:36 smithi170 bash[147513]: 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c 2024-09-20T23:27:36.373 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:36 smithi170 systemd[1]: Started Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:27:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:37.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:37.993 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:37 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:27:37.557+0000 7fc2ac8bd640 -1 Falling back to public interface 2024-09-20T23:27:38.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: pgmap v170: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.489 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.490 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: pgmap v170: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:38.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: pgmap v170: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:38.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:38.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.377 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.378 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:39.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: pgmap v171: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.327 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.328 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: pgmap v171: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.331 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.336 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: pgmap v171: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:40.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.493 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:27:41.116+0000 7fc2ac8bd640 -1 osd.2 140 log_to_monitors true 2024-09-20T23:27:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:41.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:41.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.464 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:27:42.105+0000 7fc2a4668640 -1 osd.2 140 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: pgmap v172: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:42.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.465 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: osdmap e143: 8 total, 7 up, 8 in 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.468 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: pgmap v172: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.469 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.470 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.471 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: osdmap e143: 8 total, 7 up, 8 in 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: pgmap v172: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: osdmap e143: 8 total, 7 up, 8 in 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:42.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:42.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:42.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:42.735 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:43.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937] boot 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: osdmap e144: 8 total, 8 up, 8 in 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:43.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937] boot 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: osdmap e144: 8 total, 8 up, 8 in 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: osd.2 [v2:172.21.15.170:6816/1465237937,v1:172.21.15.170:6817/1465237937] boot 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: osdmap e144: 8 total, 8 up, 8 in 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:43.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: pgmap v174: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: pgmap v174: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: osdmap e145: 8 total, 8 up, 8 in 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: osdmap e145: 8 total, 8 up, 8 in 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: pgmap v174: 161 pgs: 35 active+undersized, 11 active+undersized+degraded, 115 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:44.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: osdmap e145: 8 total, 8 up, 8 in 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:44.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: pgmap v177: 161 pgs: 5 peering, 15 active+undersized, 2 active+undersized+degraded, 139 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:27:45.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.484 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.485 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: pgmap v177: 161 pgs: 5 peering, 15 active+undersized, 2 active+undersized+degraded, 139 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.488 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.491 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.531 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.531 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.531 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.532 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: pgmap v177: 161 pgs: 5 peering, 15 active+undersized, 2 active+undersized+degraded, 139 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.533 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.534 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:45.535 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:45.536 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:45.536 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:45] "GET /metrics HTTP/1.1" 200 38452 "" "Prometheus/2.43.0" 2024-09-20T23:27:46.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.430 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.434 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.435 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.436 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.437 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.438 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded (PG_DEGRADED) 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.558 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:46.559 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.394 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.394 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.394 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.395 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: pgmap v178: 161 pgs: 5 peering, 11 active+undersized, 1 active+undersized+degraded, 144 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 1/630 objects degraded (0.159%) 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.396 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.397 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: pgmap v178: 161 pgs: 5 peering, 11 active+undersized, 1 active+undersized+degraded, 144 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 1/630 objects degraded (0.159%) 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.398 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:47 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-20T23:27:47.477 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:27:47.146+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-20T23:27:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: pgmap v178: 161 pgs: 5 peering, 11 active+undersized, 1 active+undersized+degraded, 144 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 1/630 objects degraded (0.159%) 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:27:47.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:27:47.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:47 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-20T23:27:49.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:48 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/630 objects degraded (0.159%), 1 pg degraded) 2024-09-20T23:27:49.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:48 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:27:49.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:48 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/630 objects degraded (0.159%), 1 pg degraded) 2024-09-20T23:27:49.120 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:48 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:27:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:48 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/630 objects degraded (0.159%), 1 pg degraded) 2024-09-20T23:27:49.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:48 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:27:50.161 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:49 smithi170 ceph-mon[99281]: pgmap v179: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s 2024-09-20T23:27:50.162 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:49 smithi170 ceph-mon[111392]: pgmap v179: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s 2024-09-20T23:27:50.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:49 smithi191 ceph-mon[95499]: pgmap v179: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 176 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s 2024-09-20T23:27:50.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:50 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:50.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:50 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:51.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:50 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:27:51.955 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:51 smithi170 ceph-mon[99281]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:51.955 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:51 smithi170 ceph-mon[111392]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:52.121 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:51 smithi191 ceph-mon[95499]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:53.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:54 smithi191 ceph-mon[95499]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:27:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[111392]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[99281]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:56.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:56 smithi191 ceph-mon[95499]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:56.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:27:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:27:55] "GET /metrics HTTP/1.1" 200 38452 "" "Prometheus/2.43.0" 2024-09-20T23:27:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:56 smithi170 ceph-mon[99281]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:56 smithi170 ceph-mon[111392]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:58 smithi191 ceph-mon[95499]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:27:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:58 smithi170 ceph-mon[99281]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:27:58.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:58 smithi170 ceph-mon[111392]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:27:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:27:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:27:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:27:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:00.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:00 smithi191 ceph-mon[95499]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:00 smithi170 ceph-mon[99281]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:00 smithi170 ceph-mon[111392]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:00.784 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:28:01.438 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 8s ago 18m - - 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 9s ago 18m - - 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (8m) 8s ago 13m 27.2M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (7m) 9s ago 13m 52.2M - dad864ee21e9 db20e8680365 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (6m) 8s ago 11m 60.4M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (7m) 9s ago 17m 521M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (5m) 8s ago 19m 442M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (4m) 8s ago 19m 65.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (3m) 9s ago 18m 46.2M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (4m) 8s ago 18m 53.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:28:01.439 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (8m) 8s ago 13m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (7m) 9s ago 13m 15.0M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (2m) 8s ago 17m 50.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (79s) 8s ago 17m 46.4M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (25s) 8s ago 16m 40.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (16m) 8s ago 16m 60.9M 4096M 17.2.0 e1d6a67b021e 546fd16e9c2f 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (16m) 9s ago 16m 61.8M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (15m) 9s ago 15m 62.7M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (15m) 9s ago 15m 58.1M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (14m) 9s ago 14m 61.7M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (6m) 9s ago 14m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (12m) 8s ago 12m 73.3M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (12m) 9s ago 12m 75.8M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (12m) 8s ago 12m 74.5M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:28:01.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (12m) 9s ago 12m 73.6M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:28:01.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:01 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:01.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:01 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:01.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:01 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:28:01.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:28:01.839 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "8/23 daemons upgraded", 2024-09-20T23:28:02.170 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:28:02.171 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:28:02.171 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:28:02.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:02 smithi191 ceph-mon[95499]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:02.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:02 smithi191 ceph-mon[95499]: from='client.54426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:02 smithi191 ceph-mon[95499]: from='client.54432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:02 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/643782440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[99281]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[99281]: from='client.54426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[99281]: from='client.54432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/643782440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[111392]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[111392]: from='client.54426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[111392]: from='client.54432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/643782440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:02.623 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[99281]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[99281]: Upgrade: osd.3 is safe to restart 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[99281]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1460516978' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[111392]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[111392]: Upgrade: osd.3 is safe to restart 2024-09-20T23:28:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[111392]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:03 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1460516978' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:03 smithi191 ceph-mon[95499]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:03 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T23:28:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:03 smithi191 ceph-mon[95499]: Upgrade: osd.3 is safe to restart 2024-09-20T23:28:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:03 smithi191 ceph-mon[95499]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:03 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1460516978' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:04.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[111392]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:04.431 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[99281]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:28:04.432 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:04.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:04 smithi191 ceph-mon[95499]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:04.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:04.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T23:28:04.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:05.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:05 smithi170 ceph-mon[111392]: Upgrade: Updating osd.3 2024-09-20T23:28:05.354 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:05 smithi170 ceph-mon[111392]: Deploying daemon osd.3 on smithi170 2024-09-20T23:28:05.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:05 smithi170 ceph-mon[99281]: Upgrade: Updating osd.3 2024-09-20T23:28:05.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:05 smithi170 ceph-mon[99281]: Deploying daemon osd.3 on smithi170 2024-09-20T23:28:05.485 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:05 smithi191 ceph-mon[95499]: Upgrade: Updating osd.3 2024-09-20T23:28:05.485 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:05 smithi191 ceph-mon[95499]: Deploying daemon osd.3 on smithi170 2024-09-20T23:28:05.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:05] "GET /metrics HTTP/1.1" 200 38597 "" "Prometheus/2.43.0" 2024-09-20T23:28:06.433 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:06 smithi170 ceph-mon[99281]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:06.433 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:06 smithi170 ceph-mon[111392]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:06.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:06 smithi191 ceph-mon[95499]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:06.743 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:06 smithi170 systemd[1]: Stopping Ceph osd.3 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:28:07.236 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[40743]: 2024-09-20T23:28:06.893+0000 7fab56357700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:28:07.236 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[40743]: 2024-09-20T23:28:06.893+0000 7fab56357700 -1 osd.3 145 *** Got signal Terminated *** 2024-09-20T23:28:07.236 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[40743]: 2024-09-20T23:28:06.893+0000 7fab56357700 -1 osd.3 145 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:28:07.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:07 smithi170 ceph-mon[99281]: osd.3 marked itself down and dead 2024-09-20T23:28:07.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:07 smithi170 ceph-mon[111392]: osd.3 marked itself down and dead 2024-09-20T23:28:07.635 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:07 smithi191 ceph-mon[95499]: osd.3 marked itself down and dead 2024-09-20T23:28:08.099 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:07 smithi170 podman[152860]: 2024-09-20 23:28:07.819053467 +0000 UTC m=+1.044956628 container died 546fd16e9c2f082080ae60ba6d215f79e09b6ad65e226e7c64d627d899320111 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, distribution-scope=public, name=centos-stream, release=754, architecture=x86_64, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[99281]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[99281]: osdmap e146: 8 total, 7 up, 8 in 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[111392]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:08.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:08 smithi170 ceph-mon[111392]: osdmap e146: 8 total, 7 up, 8 in 2024-09-20T23:28:08.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:08 smithi170 podman[152860]: 2024-09-20 23:28:08.314516742 +0000 UTC m=+1.540419895 container cleanup 546fd16e9c2f082080ae60ba6d215f79e09b6ad65e226e7c64d627d899320111 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., version=8, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.openshift.expose-services=, distribution-scope=public, release=754, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-09-20T23:28:08.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:08 smithi170 bash[152860]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3 2024-09-20T23:28:08.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:08 smithi191 ceph-mon[95499]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:08.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:08 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:08.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:08 smithi191 ceph-mon[95499]: osdmap e146: 8 total, 7 up, 8 in 2024-09-20T23:28:09.243 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153031]: 2024-09-20 23:28:09.026393111 +0000 UTC m=+1.281783782 container remove 546fd16e9c2f082080ae60ba6d215f79e09b6ad65e226e7c64d627d899320111 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, GIT_CLEAN=True, vendor=Red Hat, Inc., name=centos-stream, architecture=x86_64, io.openshift.tags=base centos centos-stream, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, release=754) 2024-09-20T23:28:09.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:09 smithi170 ceph-mon[99281]: osdmap e147: 8 total, 7 up, 8 in 2024-09-20T23:28:09.517 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.274891062 +0000 UTC m=+0.016798169 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:09.517 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.377215172 +0000 UTC m=+0.119122257 container create de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:28:09.518 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:09 smithi170 ceph-mon[111392]: osdmap e147: 8 total, 7 up, 8 in 2024-09-20T23:28:09.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:09 smithi191 ceph-mon[95499]: osdmap e147: 8 total, 7 up, 8 in 2024-09-20T23:28:09.833 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.613312945 +0000 UTC m=+0.355220029 container init de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, ceph=True, GIT_BRANCH=HEAD) 2024-09-20T23:28:09.833 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.616717104 +0000 UTC m=+0.358624180 container start de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-20T23:28:09.833 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.704675909 +0000 UTC m=+0.446582994 container attach de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-20T23:28:10.107 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:09 smithi170 podman[153190]: 2024-09-20 23:28:09.831668216 +0000 UTC m=+0.573575310 container died de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-20T23:28:10.443 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:10 smithi170 ceph-mon[99281]: pgmap v191: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:28:10.443 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:10 smithi170 ceph-mon[111392]: pgmap v191: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:28:10.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:10 smithi191 ceph-mon[95499]: pgmap v191: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:28:11.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:11 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:11.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:11 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:11.447 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:11 smithi170 podman[153291]: 2024-09-20 23:28:11.188184088 +0000 UTC m=+1.350309740 container remove de950138f56d50448ba887e31ef2ca64bee958c7c5656708e37d8a94a76f1079 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-20T23:28:11.447 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:11 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-20T23:28:11.447 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:11 smithi170 systemd[1]: Stopped Ceph osd.3 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:28:11.447 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:11 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.3.service: Consumed 11.733s CPU time. 2024-09-20T23:28:11.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:11 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:11.743 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:11 smithi170 systemd[1]: Starting Ceph osd.3 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[99281]: pgmap v192: 161 pgs: 26 active+undersized, 7 stale+active+clean, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 57/630 objects degraded (9.048%) 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 57/630 objects degraded (9.048%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[111392]: pgmap v192: 161 pgs: 26 active+undersized, 7 stale+active+clean, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 57/630 objects degraded (9.048%) 2024-09-20T23:28:12.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 57/630 objects degraded (9.048%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:12 smithi191 ceph-mon[95499]: pgmap v192: 161 pgs: 26 active+undersized, 7 stale+active+clean, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 57/630 objects degraded (9.048%) 2024-09-20T23:28:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:12 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 57/630 objects degraded (9.048%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:12.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:13.174 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 podman[153574]: 2024-09-20 23:28:13.062592962 +0000 UTC m=+0.345849317 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:13.803 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 podman[153574]: 2024-09-20 23:28:13.508283674 +0000 UTC m=+0.791540075 container create 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-20T23:28:13.803 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 podman[153574]: 2024-09-20 23:28:13.727330521 +0000 UTC m=+1.010586876 container init 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:28:13.804 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 podman[153574]: 2024-09-20 23:28:13.730761436 +0000 UTC m=+1.014017798 container start 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T23:28:13.804 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 podman[153574]: 2024-09-20 23:28:13.802241165 +0000 UTC m=+1.085497540 container attach 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-9e2ac70, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T23:28:14.118 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:14.118 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 bash[153574]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:14.118 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:14.118 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:13 smithi170 bash[153574]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: pgmap v193: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: pgmap v193: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: pgmap v193: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:14.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T23:28:14.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T23:28:14.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-20T23:28:14.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-20T23:28:14.879 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-20T23:28:14.880 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T23:28:14.880 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T23:28:14.880 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate[153673]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-20T23:28:14.880 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 bash[153574]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-20T23:28:14.880 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:14 smithi170 podman[153574]: 2024-09-20 23:28:14.877764807 +0000 UTC m=+2.161021163 container died 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-20T23:28:15.993 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:15 smithi170 podman[153892]: 2024-09-20 23:28:15.520775076 +0000 UTC m=+0.866326200 container remove 6590679b0f5a28dd67ed0343099053449cecba8a55c148520fa97bc6755d6721 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70) 2024-09-20T23:28:16.215 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:15] "GET /metrics HTTP/1.1" 200 38598 "" "Prometheus/2.43.0" 2024-09-20T23:28:16.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:16 smithi191 ceph-mon[95499]: pgmap v194: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:16 smithi170 ceph-mon[99281]: pgmap v194: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:16 smithi170 ceph-mon[111392]: pgmap v194: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:16.872 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 podman[154028]: 2024-09-20 23:28:16.659996062 +0000 UTC m=+0.110803571 container create 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-20T23:28:16.872 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 podman[154028]: 2024-09-20 23:28:16.566056837 +0000 UTC m=+0.016864337 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:17.190 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 podman[154028]: 2024-09-20 23:28:16.870671236 +0000 UTC m=+0.321478708 container init 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0) 2024-09-20T23:28:17.190 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 podman[154028]: 2024-09-20 23:28:16.874285296 +0000 UTC m=+0.325092770 container start 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T23:28:17.190 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 ceph-osd[154047]: -- 172.21.15.170:0/2704989758 <== mon.1 v2:172.21.15.170:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558347911a40 con 0x5583486d8000 2024-09-20T23:28:17.190 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 bash[154028]: 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e 2024-09-20T23:28:17.190 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:16 smithi170 systemd[1]: Started Ceph osd.3 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: pgmap v195: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.904 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: pgmap v196: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.905 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: pgmap v195: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: pgmap v196: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.908 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.909 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.909 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.909 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.909 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: pgmap v195: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: pgmap v196: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:17.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.993 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:28:18.525+0000 7f3cb178a640 -1 Falling back to public interface 2024-09-20T23:28:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.725 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.725 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.726 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.727 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: pgmap v197: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:19.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.729 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.730 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.731 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.732 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: pgmap v197: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:19.734 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.734 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.735 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.736 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.737 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.737 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.738 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.739 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.740 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: pgmap v197: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 82/630 objects degraded (13.016%) 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:19.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:19.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 82/630 objects degraded (13.016%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:20.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 82/630 objects degraded (13.016%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 82/630 objects degraded (13.016%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: pgmap v198: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 789 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: pgmap v198: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 789 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: pgmap v198: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 789 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:21.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.491 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:28:22.048+0000 7f3cb178a640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-20T23:28:22.491 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:28:22.081+0000 7f3cb178a640 -1 osd.3 145 log_to_monitors true 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:28:23.349+0000 7f3ca552d640 -1 osd.3 145 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.882 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.883 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: pgmap v199: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 987 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:28:23.884 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: osdmap e148: 8 total, 7 up, 8 in 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.885 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.886 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: pgmap v199: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 987 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: osdmap e148: 8 total, 7 up, 8 in 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.887 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='osd.3 ' entity='osd.3' 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.888 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.889 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='osd.3 ' entity='osd.3' 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.890 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: pgmap v199: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 181 MiB used, 715 GiB / 715 GiB avail; 987 B/s rd, 0 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: osdmap e148: 8 total, 7 up, 8 in 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='osd.3 ' entity='osd.3' 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:23.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:23.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:23.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715] boot 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: osdmap e149: 8 total, 8 up, 8 in 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:28:24.658 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715] boot 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: osdmap e149: 8 total, 8 up, 8 in 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:28:24.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: osd.3 [v2:172.21.15.170:6824/3009201715,v1:172.21.15.170:6825/3009201715] boot 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: osdmap e149: 8 total, 8 up, 8 in 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: pgmap v202: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: osdmap e150: 8 total, 8 up, 8 in 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: pgmap v202: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:25.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: pgmap v202: 161 pgs: 39 active+undersized, 27 active+undersized+degraded, 95 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 82/630 objects degraded (13.016%) 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: osdmap e150: 8 total, 8 up, 8 in 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: osdmap e150: 8 total, 8 up, 8 in 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:25.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.204 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:25] "GET /metrics HTTP/1.1" 200 38598 "" "Prometheus/2.43.0" 2024-09-20T23:28:26.896 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.896 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.896 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.896 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.898 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.900 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.901 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.902 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.903 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.904 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.905 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.906 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:26.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: pgmap v204: 161 pgs: 35 active+undersized, 23 active+undersized+degraded, 103 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: pgmap v204: 161 pgs: 35 active+undersized, 23 active+undersized+degraded, 103 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: pgmap v204: 161 pgs: 35 active+undersized, 23 active+undersized+degraded, 103 active+clean; 585 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:27.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 23 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:28.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:28.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:28.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:28.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: pgmap v205: 161 pgs: 9 active+undersized, 9 active+undersized+degraded, 143 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 22/630 objects degraded (3.492%) 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: pgmap v205: 161 pgs: 9 active+undersized, 9 active+undersized+degraded, 143 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 22/630 objects degraded (3.492%) 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: pgmap v205: 161 pgs: 9 active+undersized, 9 active+undersized+degraded, 143 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 22/630 objects degraded (3.492%) 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:29.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:29.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.910 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.913 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.914 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.915 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.916 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.917 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.918 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.919 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:28:30.647+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:30.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:30.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:31.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/630 objects degraded (3.492%), 9 pgs degraded) 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.671 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/630 objects degraded (3.492%), 9 pgs degraded) 2024-09-20T23:28:32.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:28:32.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.672 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:32 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/630 objects degraded (3.492%), 9 pgs degraded) 2024-09-20T23:28:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:32 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:28:32.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:32.979 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 2s ago 19m - - 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 1s ago 19m - - 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (8m) 2s ago 13m 27.3M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (8m) 1s ago 13m 53.0M - dad864ee21e9 db20e8680365 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (7m) 2s ago 12m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (7m) 1s ago 18m 524M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:28:33.659 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (6m) 2s ago 20m 443M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (5m) 2s ago 20m 66.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (4m) 1s ago 18m 46.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (4m) 2s ago 18m 56.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (8m) 2s ago 14m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (8m) 1s ago 14m 15.6M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (2m) 2s ago 18m 51.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (111s) 2s ago 17m 48.3M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (57s) 2s ago 17m 42.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (17s) 2s ago 16m 50.3M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (16m) 1s ago 16m 63.2M 4096M 17.2.0 e1d6a67b021e 6e8e0a1b8532 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (16m) 1s ago 16m 63.1M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (15m) 1s ago 15m 58.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (15m) 1s ago 15m 62.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (7m) 1s ago 14m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:28:33.660 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (12m) 2s ago 12m 73.5M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:28:33.661 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (12m) 1s ago 12m 76.0M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:28:33.661 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (12m) 2s ago 12m 74.8M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:28:33.661 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (12m) 1s ago 12m 73.8M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:28:33.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:33 smithi170 ceph-mon[99281]: from='client.54468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:33.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:33 smithi170 ceph-mon[99281]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:33.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:33 smithi170 ceph-mon[111392]: from='client.54468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:33.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:33 smithi170 ceph-mon[111392]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:33.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:33 smithi191 ceph-mon[95499]: from='client.54468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:33.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:33 smithi191 ceph-mon[95499]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 9 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:28:34.080 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:28:34.424 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "9/23 daemons upgraded", 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:28:34.425 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:28:34.840 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:28:34.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[99281]: from='client.74437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[99281]: from='client.54480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.906 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1114890623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:34.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[111392]: from='client.74437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[111392]: from='client.54480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.907 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:34 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1114890623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:34.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:34 smithi191 ceph-mon[95499]: from='client.74437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:34 smithi191 ceph-mon[95499]: from='client.54480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:34 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1114890623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:35.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:35 smithi191 ceph-mon[95499]: from='client.74455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:35.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:35 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3959011955' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:35.912 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:35 smithi191 ceph-mon[95499]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:35.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[99281]: from='client.74455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:35.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3959011955' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:35.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[99281]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:35.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[111392]: from='client.74455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:35.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3959011955' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:28:35.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:35 smithi170 ceph-mon[111392]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:35] "GET /metrics HTTP/1.1" 200 38615 "" "Prometheus/2.43.0" 2024-09-20T23:28:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:38 smithi191 ceph-mon[95499]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:38 smithi170 ceph-mon[99281]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:38 smithi170 ceph-mon[111392]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:39.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:39 smithi191 ceph-mon[95499]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:39.732 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:39.733 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:39 smithi170 ceph-mon[99281]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:39.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:39.733 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:39 smithi170 ceph-mon[111392]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:28:40.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:40 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:40.665 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:40 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:40.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:40 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:41.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:41 smithi191 ceph-mon[95499]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:41.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:41 smithi170 ceph-mon[99281]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:41.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:41 smithi170 ceph-mon[111392]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:44.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:44 smithi191 ceph-mon[95499]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:44.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:44.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[99281]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[111392]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:46.215 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:45] "GET /metrics HTTP/1.1" 200 38605 "" "Prometheus/2.43.0" 2024-09-20T23:28:46.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:46 smithi191 ceph-mon[95499]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:46.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:46 smithi170 ceph-mon[99281]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:46 smithi170 ceph-mon[111392]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:47 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:47 smithi191 ceph-mon[95499]: Upgrade: osd.4 is safe to restart 2024-09-20T23:28:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:47 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:47 smithi170 ceph-mon[111392]: Upgrade: osd.4 is safe to restart 2024-09-20T23:28:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:47 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:28:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:47 smithi170 ceph-mon[99281]: Upgrade: osd.4 is safe to restart 2024-09-20T23:28:48.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:48 smithi191 ceph-mon[95499]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:48 smithi170 ceph-mon[99281]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:48.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:48 smithi170 ceph-mon[111392]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: Upgrade: Updating osd.4 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: Deploying daemon osd.4 on smithi191 2024-09-20T23:28:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:49 smithi191 ceph-mon[95499]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: Upgrade: Updating osd.4 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: Deploying daemon osd.4 on smithi191 2024-09-20T23:28:49.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[99281]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: Upgrade: Updating osd.4 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: Deploying daemon osd.4 on smithi191 2024-09-20T23:28:49.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:49 smithi170 ceph-mon[111392]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:50.437 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:50 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:50 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:50 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:28:51.450 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:51 smithi191 ceph-mon[95499]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:51.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:51 smithi170 ceph-mon[99281]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:51.630 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:51 smithi170 ceph-mon[111392]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:28:52.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:51 smithi191 systemd[1]: Stopping Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:28:52.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[29387]: 2024-09-20T23:28:52.044+0000 7f104ffc8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:28:52.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[29387]: 2024-09-20T23:28:52.044+0000 7f104ffc8700 -1 osd.4 150 *** Got signal Terminated *** 2024-09-20T23:28:52.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[29387]: 2024-09-20T23:28:52.044+0000 7f104ffc8700 -1 osd.4 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: osd.4 marked itself down and dead 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.957 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: osd.4 marked itself down and dead 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.958 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.964 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: osd.4 marked itself down and dead 2024-09-20T23:28:52.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:52.965 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:53.226 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:52 smithi191 podman[120953]: 2024-09-20 23:28:52.962620185 +0000 UTC m=+1.019730354 container died 6e8e0a1b8532dddd9f4826eecbf01d97a0e8a5a95c0f3b69b7256889a14bd9a8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, ceph=True, io.openshift.expose-services=, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , GIT_CLEAN=True, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, name=centos-stream, architecture=x86_64, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc.) 2024-09-20T23:28:53.622 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:53 smithi191 podman[120953]: 2024-09-20 23:28:53.38637922 +0000 UTC m=+1.443489381 container cleanup 6e8e0a1b8532dddd9f4826eecbf01d97a0e8a5a95c0f3b69b7256889a14bd9a8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, release=754, name=centos-stream, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , vcs-type=git, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container) 2024-09-20T23:28:53.622 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:53 smithi191 bash[120953]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4 2024-09-20T23:28:53.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:53.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[99281]: osdmap e151: 8 total, 7 up, 8 in 2024-09-20T23:28:53.934 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[99281]: pgmap v218: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:28:53.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:53.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[111392]: osdmap e151: 8 total, 7 up, 8 in 2024-09-20T23:28:53.935 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:53 smithi170 ceph-mon[111392]: pgmap v218: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:28:53.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:53 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:28:53.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:53 smithi191 ceph-mon[95499]: osdmap e151: 8 total, 7 up, 8 in 2024-09-20T23:28:53.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:53 smithi191 ceph-mon[95499]: pgmap v218: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:28:53.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:53 smithi191 podman[120992]: 2024-09-20 23:28:53.629413298 +0000 UTC m=+0.661786317 container remove 6e8e0a1b8532dddd9f4826eecbf01d97a0e8a5a95c0f3b69b7256889a14bd9a8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, release=754, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., name=centos-stream, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , vcs-type=git, version=8, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, ceph=True, com.redhat.component=centos-stream-container) 2024-09-20T23:28:54.301 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:53.950676877 +0000 UTC m=+0.016105036 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:54.301 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:54.07232174 +0000 UTC m=+0.137749881 container create 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-20T23:28:54.301 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:54.29968638 +0000 UTC m=+0.365114540 container init 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T23:28:54.635 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:54.303155091 +0000 UTC m=+0.368583236 container start 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-20T23:28:54.635 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:54.383091383 +0000 UTC m=+0.448519555 container attach 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T23:28:54.635 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:54 smithi191 podman[121082]: 2024-09-20 23:28:54.496617354 +0000 UTC m=+0.562045505 container died 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-20T23:28:54.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:54 smithi191 ceph-mon[95499]: osdmap e152: 8 total, 7 up, 8 in 2024-09-20T23:28:54.984 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:54 smithi170 ceph-mon[99281]: osdmap e152: 8 total, 7 up, 8 in 2024-09-20T23:28:54.984 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:54 smithi170 ceph-mon[111392]: osdmap e152: 8 total, 7 up, 8 in 2024-09-20T23:28:55.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121106]: 2024-09-20 23:28:55.161852978 +0000 UTC m=+0.659382102 container remove 98fb0e2c7b282c99941bfa20debb64c4b1a17c6b1c366904dbbad1332298527b (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-20T23:28:55.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-20T23:28:55.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 systemd[1]: Stopped Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:28:55.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service: Consumed 11.385s CPU time. 2024-09-20T23:28:55.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 systemd[1]: Starting Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:28:55.849 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:55 smithi191 ceph-mon[95499]: pgmap v220: 161 pgs: 24 active+undersized, 10 peering, 5 stale+active+clean, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:28:55.850 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121208]: 2024-09-20 23:28:55.495715167 +0000 UTC m=+0.016722117 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:55.850 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121208]: 2024-09-20 23:28:55.596023045 +0000 UTC m=+0.117030050 container create ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:28:55.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:55 smithi170 ceph-mon[99281]: pgmap v220: 161 pgs: 24 active+undersized, 10 peering, 5 stale+active+clean, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:28:55.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:55 smithi170 ceph-mon[111392]: pgmap v220: 161 pgs: 24 active+undersized, 10 peering, 5 stale+active+clean, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:28:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:28:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:28:55] "GET /metrics HTTP/1.1" 200 38605 "" "Prometheus/2.43.0" 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121208]: 2024-09-20 23:28:55.848737667 +0000 UTC m=+0.369744612 container init ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121208]: 2024-09-20 23:28:55.852235991 +0000 UTC m=+0.373242928 container start ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 podman[121208]: 2024-09-20 23:28:55.940502378 +0000 UTC m=+0.461509322 container attach ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70) 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 bash[121208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:56.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:55 smithi191 bash[121208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:28:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:56 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:28:56.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:56 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 73/630 objects degraded (11.587%), 19 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:56.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:56 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:28:56.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:56 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 73/630 objects degraded (11.587%), 19 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:56.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:56 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T23:28:56.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:56 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 73/630 objects degraded (11.587%), 19 pgs degraded (PG_DEGRADED) 2024-09-20T23:28:57.645 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:28:57.646 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:28:57.646 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:28:57.646 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:28:57.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-mon[95499]: pgmap v221: 161 pgs: 27 active+undersized, 10 peering, 3 stale+active+clean, 25 active+undersized+degraded, 96 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 99/630 objects degraded (15.714%) 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[121223]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 bash[121208]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-20T23:28:57.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:57 smithi191 podman[121208]: 2024-09-20 23:28:57.687634211 +0000 UTC m=+2.208641158 container died ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-20T23:28:57.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:57 smithi170 ceph-mon[99281]: pgmap v221: 161 pgs: 27 active+undersized, 10 peering, 3 stale+active+clean, 25 active+undersized+degraded, 96 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 99/630 objects degraded (15.714%) 2024-09-20T23:28:57.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:57 smithi170 ceph-mon[111392]: pgmap v221: 161 pgs: 27 active+undersized, 10 peering, 3 stale+active+clean, 25 active+undersized+degraded, 96 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 99/630 objects degraded (15.714%) 2024-09-20T23:28:58.678 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 podman[121364]: 2024-09-20 23:28:58.335836656 +0000 UTC m=+0.641272857 container remove ad9a59216e9731963dc553dec124655ec6a6a255e5509cf284f899b5a4f3487a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T23:28:58.679 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 podman[121423]: 2024-09-20 23:28:58.454611885 +0000 UTC m=+0.017544146 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:28:58.679 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 podman[121423]: 2024-09-20 23:28:58.578424755 +0000 UTC m=+0.141357005 container create 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-20T23:28:59.213 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 podman[121423]: 2024-09-20 23:28:58.781051176 +0000 UTC m=+0.343983436 container init 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:28:59.213 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 podman[121423]: 2024-09-20 23:28:58.784370431 +0000 UTC m=+0.347302682 container start 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:28:59.214 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 ceph-osd[121443]: -- 172.21.15.191:0/1391672653 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d62ef49a40 con 0x55d62ef27c00 2024-09-20T23:28:59.214 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 bash[121423]: 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d 2024-09-20T23:28:59.214 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:28:58 smithi191 systemd[1]: Started Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:28:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.482 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.483 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:59.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:28:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: pgmap v222: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: pgmap v222: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: pgmap v222: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T23:29:00.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:00.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:00.976 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:00 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:00.671+0000 7f0f0171f640 -1 Falling back to public interface 2024-09-20T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:01 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:01.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:01 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: pgmap v223: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:02.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: pgmap v223: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: pgmap v223: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:02.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:02.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:02.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:02.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:02.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:03.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:04.219+0000 7f0f0171f640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-20T23:29:04.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:04.254+0000 7f0f0171f640 -1 osd.4 150 log_to_monitors true 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: pgmap v224: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: pgmap v224: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: pgmap v224: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:04.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.205 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:29:05.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:05 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 14s ago 19m - - 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 13s ago 19m - - 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (9m) 14s ago 14m 27.3M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (8m) 13s ago 14m 52.1M - dad864ee21e9 db20e8680365 2024-09-20T23:29:05.904 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (7m) 14s ago 12m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (8m) 13s ago 19m 524M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (6m) 14s ago 20m 443M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (5m) 14s ago 20m 67.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (4m) 13s ago 19m 44.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (5m) 14s ago 19m 58.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (9m) 14s ago 15m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (8m) 13s ago 15m 15.2M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (3m) 14s ago 18m 51.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (2m) 14s ago 18m 48.4M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (90s) 14s ago 17m 42.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (49s) 14s ago 17m 50.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 starting - - - 4096M 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (16m) 13s ago 16m 63.1M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (16m) 13s ago 16m 58.3M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:29:05.905 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (15m) 13s ago 15m 62.3M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:29:05.906 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (7m) 13s ago 15m 69.5M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:29:05.906 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (13m) 14s ago 13m 73.5M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:29:05.906 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (13m) 13s ago 13m 76.1M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:29:05.906 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (13m) 14s ago 13m 74.9M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:29:05.906 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (13m) 13s ago 13m 73.9M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:29:05.910 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:05.732+0000 7f0ef54c2640 -1 osd.4 150 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:29:06.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:05] "GET /metrics HTTP/1.1" 200 38605 "" "Prometheus/2.43.0" 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:29:06.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 9 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:29:06.364 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:29:06.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: pgmap v225: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: osdmap e153: 8 total, 7 up, 8 in 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: pgmap v225: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:06.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: osdmap e153: 8 total, 7 up, 8 in 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:06 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "9/23 daemons upgraded", 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:29:06.713 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: pgmap v225: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 110/630 objects degraded (17.460%) 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: osdmap e153: 8 total, 7 up, 8 in 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:06.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:06 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.148 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.6 is active+undersized+degraded, acting [1,6] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.b is active+undersized+degraded, acting [7,5] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.f is active+undersized+degraded, acting [0,7] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.13 is active+undersized+degraded, acting [0,3] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.18 is active+undersized+degraded, acting [5,7] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1a is active+undersized+degraded, acting [6,7] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1 is active+undersized+degraded, acting [0,3] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.3 is active+undersized+degraded, acting [0,6] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.6 is active+undersized+degraded, acting [0,1] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.9 is active+undersized+degraded, acting [2,7] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.a is active+undersized+degraded, acting [6,1] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.b is active+undersized+degraded, acting [3,0] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.e is active+undersized+degraded, acting [7,1] 2024-09-20T23:29:07.149 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.f is active+undersized+degraded, acting [7,0] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.11 is active+undersized+degraded, acting [7,6] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.13 is active+undersized+degraded, acting [7,2] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.14 is active+undersized+degraded, acting [7,6] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.15 is active+undersized+degraded, acting [7,3] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.19 is active+undersized+degraded, acting [1,3] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1a is active+undersized+degraded, acting [1,2] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1b is active+undersized+degraded, acting [0,7] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1c is active+undersized+degraded, acting [5,1] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [5,6] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.9 is active+undersized+degraded, acting [1,3] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.d is active+undersized+degraded, acting [2,1] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.e is active+undersized+degraded, acting [6,1] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.1c is active+undersized+degraded, acting [3,2] 2024-09-20T23:29:07.150 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.1d is active+undersized+degraded, acting [1,0] 2024-09-20T23:29:07.151 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.1a is active+undersized+degraded, acting [5,1] 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='client.54513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/4209171777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262] boot 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: osdmap e154: 8 total, 8 up, 8 in 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.372 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/110954133' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.373 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:07 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='client.54513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/4209171777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='client.54513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:07.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/4209171777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262] boot 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: osdmap e154: 8 total, 8 up, 8 in 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:07.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/110954133' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: osd.4 [v2:172.21.15.191:6800/3825972262,v1:172.21.15.191:6801/3825972262] boot 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: osdmap e154: 8 total, 8 up, 8 in 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:07.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/110954133' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:07.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:07 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='client.54531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: pgmap v228: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='client.54531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: pgmap v228: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: osdmap e155: 8 total, 8 up, 8 in 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: osdmap e155: 8 total, 8 up, 8 in 2024-09-20T23:29:08.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:08 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='client.54531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.547 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: pgmap v228: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.548 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: osdmap e155: 8 total, 8 up, 8 in 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.549 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:08.550 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:08.551 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:08 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:09.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:09.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:09.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:09.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:09.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:09.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.240 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: pgmap v230: 161 pgs: 4 peering, 28 active+undersized, 25 active+undersized+degraded, 104 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.241 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.242 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: pgmap v230: 161 pgs: 4 peering, 28 active+undersized, 25 active+undersized+degraded, 104 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.564 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: pgmap v230: 161 pgs: 4 peering, 28 active+undersized, 25 active+undersized+degraded, 104 active+clean; 585 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.565 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:10.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: pgmap v231: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded) 2024-09-20T23:29:12.427 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: pgmap v231: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: pgmap v231: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded) 2024-09-20T23:29:12.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded) 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:12.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:12.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:29:12.611+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.470 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.471 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.472 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.474 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.475 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.673 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.674 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:13.676 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.426 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:15] "GET /metrics HTTP/1.1" 200 38613 "" "Prometheus/2.43.0" 2024-09-20T23:29:16.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:16 smithi170 ceph-mon[99281]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:16 smithi170 ceph-mon[111392]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:16.689 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:16 smithi191 ceph-mon[95499]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:18.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:18 smithi191 ceph-mon[95499]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:29:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:18 smithi170 ceph-mon[99281]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:29:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:18 smithi170 ceph-mon[111392]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:29:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:19 smithi170 ceph-mon[99281]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:29:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:19.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:19 smithi170 ceph-mon[111392]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:29:19.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:19.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:19 smithi191 ceph-mon[95499]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:29:20.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:21 smithi191 ceph-mon[95499]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:21 smithi170 ceph-mon[99281]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:21 smithi170 ceph-mon[111392]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:24.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:24 smithi191 ceph-mon[95499]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:24 smithi170 ceph-mon[111392]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:24 smithi170 ceph-mon[99281]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:26.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:26 smithi191 ceph-mon[95499]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:26.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:25] "GET /metrics HTTP/1.1" 200 38613 "" "Prometheus/2.43.0" 2024-09-20T23:29:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:26 smithi170 ceph-mon[99281]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:26 smithi170 ceph-mon[111392]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:28.313 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:28 smithi191 ceph-mon[95499]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:28.313 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:28 smithi170 ceph-mon[99281]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:28.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:28 smithi170 ceph-mon[111392]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:28.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:29.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:29 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:29.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:29 smithi191 ceph-mon[95499]: Upgrade: osd.4 is safe to restart 2024-09-20T23:29:29.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:29.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:29:29.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[99281]: Upgrade: osd.4 is safe to restart 2024-09-20T23:29:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:29:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:29.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T23:29:29.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[111392]: Upgrade: osd.4 is safe to restart 2024-09-20T23:29:29.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:29.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T23:29:29.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:30 smithi191 ceph-mon[95499]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:30 smithi191 ceph-mon[95499]: Upgrade: Updating osd.4 2024-09-20T23:29:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:30 smithi191 ceph-mon[95499]: Deploying daemon osd.4 on smithi191 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[99281]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[99281]: Upgrade: Updating osd.4 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[99281]: Deploying daemon osd.4 on smithi191 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[111392]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[111392]: Upgrade: Updating osd.4 2024-09-20T23:29:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:30 smithi170 ceph-mon[111392]: Deploying daemon osd.4 on smithi191 2024-09-20T23:29:31.381 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:31 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:31 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:31 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:32.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:32 smithi191 systemd[1]: Stopping Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:29:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-mon[95499]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[99281]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[111392]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:32.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:32.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:32.497+0000 7f0efe6b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:29:32.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:32.497+0000 7f0efe6b7640 -1 osd.4 155 *** Got signal Terminated *** 2024-09-20T23:29:32.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[121439]: 2024-09-20T23:29:32.497+0000 7f0efe6b7640 -1 osd.4 155 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:29:33.389 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:33 smithi170 ceph-mon[99281]: osd.4 marked itself down and dead 2024-09-20T23:29:33.389 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:33 smithi170 ceph-mon[111392]: osd.4 marked itself down and dead 2024-09-20T23:29:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:33 smithi191 ceph-mon[95499]: osd.4 marked itself down and dead 2024-09-20T23:29:33.834 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:33 smithi191 podman[127373]: 2024-09-20 23:29:33.523059937 +0000 UTC m=+1.183164660 container died 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:29:34.137 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:34 smithi191 podman[127373]: 2024-09-20 23:29:34.014921372 +0000 UTC m=+1.675026082 container cleanup 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-20T23:29:34.137 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:34 smithi191 bash[127373]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4 2024-09-20T23:29:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:34.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:29:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: osdmap e156: 8 total, 7 up, 8 in 2024-09-20T23:29:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:34 smithi191 podman[127398]: 2024-09-20 23:29:34.285361395 +0000 UTC m=+0.762318246 container remove 1219a9b83a84938a69b0ecdabac25d362170c0f2168a00a728fdbcd86c8df75d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: osdmap e156: 8 total, 7 up, 8 in 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.481 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:29:34.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:29:34.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: osdmap e156: 8 total, 7 up, 8 in 2024-09-20T23:29:34.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.482 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:34.974 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:34 smithi191 podman[127503]: 2024-09-20 23:29:34.525937016 +0000 UTC m=+0.016064634 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:29:34.975 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:34 smithi191 podman[127503]: 2024-09-20 23:29:34.635255375 +0000 UTC m=+0.125382969 container create 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:29:35.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:35 smithi191 ceph-mon[95499]: osdmap e157: 8 total, 7 up, 8 in 2024-09-20T23:29:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:35 smithi170 ceph-mon[99281]: osdmap e157: 8 total, 7 up, 8 in 2024-09-20T23:29:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:35 smithi170 ceph-mon[111392]: osdmap e157: 8 total, 7 up, 8 in 2024-09-20T23:29:35.859 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:35 smithi191 podman[127503]: 2024-09-20 23:29:35.485509491 +0000 UTC m=+0.975637104 container init 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2) 2024-09-20T23:29:35.859 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:35 smithi191 podman[127503]: 2024-09-20 23:29:35.489114673 +0000 UTC m=+0.979242275 container start 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:29:35.859 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:35 smithi191 podman[127503]: 2024-09-20 23:29:35.577472131 +0000 UTC m=+1.067599739 container attach 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:29:36.114 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:35] "GET /metrics HTTP/1.1" 200 38609 "" "Prometheus/2.43.0" 2024-09-20T23:29:36.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:36 smithi191 ceph-mon[95499]: pgmap v245: 161 pgs: 18 active+undersized, 8 peering, 14 stale+active+clean, 14 active+undersized+degraded, 107 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-09-20T23:29:36.428 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:36 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 58/630 objects degraded (9.206%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:36.428 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 podman[127503]: 2024-09-20 23:29:36.113039371 +0000 UTC m=+1.603166973 container died 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-20T23:29:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:36 smithi170 ceph-mon[99281]: pgmap v245: 161 pgs: 18 active+undersized, 8 peering, 14 stale+active+clean, 14 active+undersized+degraded, 107 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-09-20T23:29:36.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:36 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 58/630 objects degraded (9.206%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:36 smithi170 ceph-mon[111392]: pgmap v245: 161 pgs: 18 active+undersized, 8 peering, 14 stale+active+clean, 14 active+undersized+degraded, 107 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-09-20T23:29:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:36 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 58/630 objects degraded (9.206%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:36.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 podman[127559]: 2024-09-20 23:29:36.719884641 +0000 UTC m=+1.028299594 container remove 344c1c56d1befec955df62a7915bf26be2e46062324f93ebcfc052992d868603 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-20T23:29:36.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-20T23:29:36.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 systemd[1]: Stopped Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:29:36.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service: Consumed 2.204s CPU time. 2024-09-20T23:29:36.977 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:36 smithi191 systemd[1]: Starting Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:29:37.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 podman[127664]: 2024-09-20 23:29:37.146622366 +0000 UTC m=+0.107556603 container create 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-20T23:29:37.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 podman[127664]: 2024-09-20 23:29:37.055640561 +0000 UTC m=+0.016574806 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:29:37.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 podman[127664]: 2024-09-20 23:29:37.38353011 +0000 UTC m=+0.344464345 container init 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-20T23:29:37.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 podman[127664]: 2024-09-20 23:29:37.387048344 +0000 UTC m=+0.347982582 container start 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-20T23:29:37.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 podman[127664]: 2024-09-20 23:29:37.475384276 +0000 UTC m=+0.436318517 container attach 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-20T23:29:37.513 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:29:37.726 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:29:37.726 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 bash[127664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:29:37.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:29:37.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:37 smithi191 bash[127664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 6s ago 20m - - 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 4s ago 20m - - 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (9m) 6s ago 15m 27.3M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (9m) 4s ago 14m 51.8M - dad864ee21e9 db20e8680365 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (8m) 6s ago 13m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (8m) 4s ago 19m 526M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (7m) 6s ago 21m 443M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:29:38.165 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (6m) 6s ago 21m 68.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (5m) 4s ago 19m 47.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (5m) 6s ago 20m 57.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (9m) 6s ago 15m 16.4M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (9m) 4s ago 15m 15.7M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 6s ago 19m 54.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (2m) 6s ago 18m 50.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (2m) 6s ago 18m 43.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (81s) 6s ago 18m 51.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (39s) 4s ago 17m 52.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1219a9b83a84 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (17m) 4s ago 17m 64.3M 4096M 17.2.0 e1d6a67b021e 036d970da966 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (16m) 4s ago 16m 60.1M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (16m) 4s ago 16m 62.9M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (8m) 4s ago 15m 69.5M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:29:38.166 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (13m) 6s ago 13m 73.7M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:29:38.167 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (13m) 4s ago 13m 76.3M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:29:38.167 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (13m) 6s ago 13m 75.1M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:29:38.167 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (13m) 4s ago 13m 74.0M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:29:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:38 smithi191 ceph-mon[95499]: pgmap v246: 161 pgs: 21 active+undersized, 8 peering, 12 stale+active+clean, 20 active+undersized+degraded, 100 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 84/630 objects degraded (13.333%) 2024-09-20T23:29:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:38 smithi170 ceph-mon[99281]: pgmap v246: 161 pgs: 21 active+undersized, 8 peering, 12 stale+active+clean, 20 active+undersized+degraded, 100 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 84/630 objects degraded (13.333%) 2024-09-20T23:29:38.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:38 smithi170 ceph-mon[111392]: pgmap v246: 161 pgs: 21 active+undersized, 8 peering, 12 stale+active+clean, 20 active+undersized+degraded, 100 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 84/630 objects degraded (13.333%) 2024-09-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:29:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:29:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-09-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 9 2024-09-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:29:38.565 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:29:38.899 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "10/23 daemons upgraded", 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:29:38.900 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:29:39.153 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:29:39.153 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:38 smithi191 bash[127664]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:29:39.154 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:29:39.154 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:38 smithi191 bash[127664]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-20T23:29:39.294 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded 2024-09-20T23:29:39.294 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T23:29:39.294 INFO:teuthology.orchestra.run.smithi170.stdout: osd.4 (root=default,host=smithi191) is down 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.6 is active+undersized+degraded, acting [1,6] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.b is active+undersized+degraded, acting [7,5] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.f is active+undersized+degraded, acting [0,7] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.13 is active+undersized+degraded, acting [0,3] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.18 is active+undersized+degraded, acting [5,7] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1a is active+undersized+degraded, acting [6,7] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1 is active+undersized+degraded, acting [0,3] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.3 is active+undersized+degraded, acting [0,6] 2024-09-20T23:29:39.295 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.6 is active+undersized+degraded, acting [0,1] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.9 is active+undersized+degraded, acting [2,7] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.a is active+undersized+degraded, acting [6,1] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.b is active+undersized+degraded, acting [3,0] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.e is active+undersized+degraded, acting [7,1] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.f is active+undersized+degraded, acting [7,0] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.11 is active+undersized+degraded, acting [7,6] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.13 is active+undersized+degraded, acting [7,2] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.14 is active+undersized+degraded, acting [7,6] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.15 is active+undersized+degraded, acting [7,3] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.19 is active+undersized+degraded, acting [1,3] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1a is active+undersized+degraded, acting [1,2] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1b is active+undersized+degraded, acting [0,7] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1c is active+undersized+degraded, acting [5,1] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [5,6] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.9 is active+undersized+degraded, acting [1,3] 2024-09-20T23:29:39.296 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.d is active+undersized+degraded, acting [2,1] 2024-09-20T23:29:39.297 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.e is active+undersized+degraded, acting [6,1] 2024-09-20T23:29:39.297 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.1c is active+undersized+degraded, acting [3,2] 2024-09-20T23:29:39.297 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.1d is active+undersized+degraded, acting [1,0] 2024-09-20T23:29:39.297 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.1a is active+undersized+degraded, acting [5,1] 2024-09-20T23:29:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-mon[95499]: from='client.54543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-mon[95499]: from='client.74512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-mon[95499]: from='client.74518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/2846148000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 bash[127664]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 bash[127664]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 bash[127664]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 bash[127664]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T23:29:39.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate[127679]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-20T23:29:39.478 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 bash[127664]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-20T23:29:39.478 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 podman[127664]: 2024-09-20 23:29:39.211431913 +0000 UTC m=+2.172366154 container died 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[99281]: from='client.54543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[99281]: from='client.74512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[99281]: from='client.74518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2846148000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[111392]: from='client.54543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[111392]: from='client.74512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[111392]: from='client.74518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:39 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2846148000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:40.092 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 podman[127824]: 2024-09-20 23:29:39.763595077 +0000 UTC m=+0.542882007 container remove 0518ef9451f616c4ea6f68612add208c66d1d7cab3570c1c85e5b0794d0020e9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-20T23:29:40.092 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 podman[127882]: 2024-09-20 23:29:39.872395595 +0000 UTC m=+0.016414183 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:29:40.092 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:39 smithi191 podman[127882]: 2024-09-20 23:29:39.981716609 +0000 UTC m=+0.125735193 container create 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-20T23:29:40.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:40 smithi191 ceph-mon[95499]: from='client.54567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:40 smithi191 ceph-mon[95499]: pgmap v247: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:40 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/2044804883' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:40.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:40 smithi191 podman[127882]: 2024-09-20 23:29:40.193299025 +0000 UTC m=+0.337317612 container init 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:29:40.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:40 smithi191 podman[127882]: 2024-09-20 23:29:40.196625568 +0000 UTC m=+0.340644156 container start 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:29:40.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:40 smithi191 ceph-osd[127901]: -- 172.21.15.191:0/3649270063 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fde3ac1a40 con 0x55fde4888000 2024-09-20T23:29:40.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:40 smithi191 bash[127882]: 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 2024-09-20T23:29:40.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:40 smithi191 systemd[1]: Started Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[99281]: from='client.54567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[99281]: pgmap v247: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2044804883' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[111392]: from='client.54567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[111392]: pgmap v247: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:40.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:40 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2044804883' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:29:41.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:41.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.446 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 110/630 objects degraded (17.460%), 29 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.347 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:29:42.081+0000 7f89e1b60640 -1 Falling back to public interface 2024-09-20T23:29:42.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: pgmap v248: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.348 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.349 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.350 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.351 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.352 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: pgmap v248: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: pgmap v248: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:42.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.415 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.416 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.417 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.418 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.418 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: pgmap v249: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 515 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:44.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: pgmap v249: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 515 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: pgmap v249: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 515 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:44.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:45.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:45.910 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:29:45.691+0000 7f89e1b60640 -1 osd.4 155 log_to_monitors true 2024-09-20T23:29:46.163 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:45] "GET /metrics HTTP/1.1" 200 38622 "" "Prometheus/2.43.0" 2024-09-20T23:29:46.471 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: pgmap v250: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.472 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.473 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.474 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.475 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: pgmap v250: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: pgmap v250: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:46.726 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:29:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:29:46.602+0000 7f89d5903640 -1 osd.4 155 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.454 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.455 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: osdmap e158: 8 total, 7 up, 8 in 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.456 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.457 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.458 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: osdmap e158: 8 total, 7 up, 8 in 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: osdmap e158: 8 total, 7 up, 8 in 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:47.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: pgmap v252: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969] boot 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: osdmap e159: 8 total, 8 up, 8 in 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: pgmap v252: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: pgmap v252: 161 pgs: 40 active+undersized, 29 active+undersized+degraded, 92 active+clean; 585 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 110/630 objects degraded (17.460%) 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969] boot 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: osdmap e159: 8 total, 8 up, 8 in 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: osd.4 [v2:172.21.15.191:6800/3093593969,v1:172.21.15.191:6801/3093593969] boot 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: osdmap e159: 8 total, 8 up, 8 in 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T23:29:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:48.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:48.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:48.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:48.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: osdmap e160: 8 total, 8 up, 8 in 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: osdmap e160: 8 total, 8 up, 8 in 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: osdmap e160: 8 total, 8 up, 8 in 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:49.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: pgmap v255: 161 pgs: 4 peering, 32 active+undersized, 25 active+undersized+degraded, 100 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.392 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.393 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.394 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.395 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: pgmap v255: 161 pgs: 4 peering, 32 active+undersized, 25 active+undersized+degraded, 100 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: pgmap v255: 161 pgs: 4 peering, 32 active+undersized, 25 active+undersized+degraded, 100 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 96/630 objects degraded (15.238%) 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 96/630 objects degraded (15.238%), 25 pgs degraded (PG_DEGRADED) 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:50.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.483 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:51.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: pgmap v256: 161 pgs: 4 peering, 17 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.211 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.212 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.213 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.214 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.215 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.215 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.215 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.215 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: pgmap v256: 161 pgs: 4 peering, 17 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: pgmap v256: 161 pgs: 4 peering, 17 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.504 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.505 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.506 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.508 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.508 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.508 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.508 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.509 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:52.510 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:52.511 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:52.511 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:52.511 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:52.511 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.204 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.205 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.206 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.207 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.208 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.208 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.208 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:53.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: pgmap v257: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 790 B/s rd, 0 op/s 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 10 pgs degraded) 2024-09-20T23:29:54.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:54 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: pgmap v257: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 790 B/s rd, 0 op/s 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: pgmap v257: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 790 B/s rd, 0 op/s 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 10 pgs degraded) 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:29:54.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 10 pgs degraded) 2024-09-20T23:29:54.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:54 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:29:55.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:55.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-mon[95499]: Upgrade: osd.5 is safe to restart 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[99281]: Upgrade: osd.5 is safe to restart 2024-09-20T23:29:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:29:55.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:29:55.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:55 smithi170 ceph-mon[111392]: Upgrade: osd.5 is safe to restart 2024-09-20T23:29:56.142 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:29:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:29:55] "GET /metrics HTTP/1.1" 200 38622 "" "Prometheus/2.43.0" 2024-09-20T23:29:56.411 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[99281]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[111392]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:56 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.459 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:56 smithi191 ceph-mon[95499]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:29:56.459 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.459 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:56.459 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:56 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:29:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:57 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:29:57.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:57 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:58 smithi191 ceph-mon[95499]: Upgrade: Updating osd.5 2024-09-20T23:29:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:58 smithi191 ceph-mon[95499]: Deploying daemon osd.5 on smithi191 2024-09-20T23:29:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:58 smithi191 ceph-mon[95499]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:29:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:58.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:29:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[99281]: Upgrade: Updating osd.5 2024-09-20T23:29:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[99281]: Deploying daemon osd.5 on smithi191 2024-09-20T23:29:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[99281]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:29:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:58.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:29:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[111392]: Upgrade: Updating osd.5 2024-09-20T23:29:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[111392]: Deploying daemon osd.5 on smithi191 2024-09-20T23:29:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[111392]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:29:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:29:58.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:29:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:00 smithi170 ceph-mon[99281]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-20T23:30:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:00 smithi170 ceph-mon[99281]: overall HEALTH_OK 2024-09-20T23:30:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:00 smithi170 ceph-mon[111392]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-20T23:30:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:00 smithi170 ceph-mon[111392]: overall HEALTH_OK 2024-09-20T23:30:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:00 smithi191 ceph-mon[95499]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-20T23:30:00.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:00 smithi191 ceph-mon[95499]: overall HEALTH_OK 2024-09-20T23:30:01.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:01 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:01.463 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:01 smithi191 systemd[1]: Stopping Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:30:01.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:01 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:01.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:01 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:01.726 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[32276]: 2024-09-20T23:30:01.461+0000 7fda59b2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:30:01.726 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[32276]: 2024-09-20T23:30:01.461+0000 7fda59b2f700 -1 osd.5 160 *** Got signal Terminated *** 2024-09-20T23:30:01.726 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:01 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[32276]: 2024-09-20T23:30:01.461+0000 7fda59b2f700 -1 osd.5 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:30:02.679 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:02 smithi191 ceph-mon[95499]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:02.679 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:02 smithi191 ceph-mon[95499]: osd.5 marked itself down and dead 2024-09-20T23:30:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:02 smithi170 ceph-mon[99281]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:02 smithi170 ceph-mon[99281]: osd.5 marked itself down and dead 2024-09-20T23:30:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:02 smithi170 ceph-mon[111392]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:02 smithi170 ceph-mon[111392]: osd.5 marked itself down and dead 2024-09-20T23:30:02.968 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:02 smithi191 podman[133660]: 2024-09-20 23:30:02.67761797 +0000 UTC m=+1.375343435 container died 036d970da96607e26da94ac321fc675c0d91c9b075b5579abc3cf31c5ca04d8d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, distribution-scope=public, vcs-type=git, GIT_BRANCH=HEAD, GIT_CLEAN=True, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, release=754) 2024-09-20T23:30:03.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:03 smithi191 podman[133660]: 2024-09-20 23:30:03.16541399 +0000 UTC m=+1.863139448 container cleanup 036d970da96607e26da94ac321fc675c0d91c9b075b5579abc3cf31c5ca04d8d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, ceph=True, RELEASE=HEAD, vendor=Red Hat, Inc., version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, name=centos-stream, GIT_CLEAN=True, distribution-scope=public, vcs-type=git, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux ) 2024-09-20T23:30:03.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:03 smithi191 bash[133660]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5 2024-09-20T23:30:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:03 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:03.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:03 smithi191 ceph-mon[95499]: osdmap e161: 8 total, 7 up, 8 in 2024-09-20T23:30:03.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:03 smithi191 podman[133675]: 2024-09-20 23:30:03.450578363 +0000 UTC m=+0.767199801 container remove 036d970da96607e26da94ac321fc675c0d91c9b075b5579abc3cf31c5ca04d8d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, architecture=x86_64, io.openshift.tags=base centos centos-stream, name=centos-stream, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, vendor=Red Hat, Inc.) 2024-09-20T23:30:03.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:03 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:03.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:03 smithi170 ceph-mon[111392]: osdmap e161: 8 total, 7 up, 8 in 2024-09-20T23:30:03.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:03 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:03.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:03 smithi170 ceph-mon[99281]: osdmap e161: 8 total, 7 up, 8 in 2024-09-20T23:30:04.047 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:03 smithi191 podman[133763]: 2024-09-20 23:30:03.698511273 +0000 UTC m=+0.016177364 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:04.047 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:03 smithi191 podman[133763]: 2024-09-20 23:30:03.827040117 +0000 UTC m=+0.144706199 container create 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T23:30:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:04 smithi191 ceph-mon[95499]: pgmap v263: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:30:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:04 smithi191 ceph-mon[95499]: osdmap e162: 8 total, 7 up, 8 in 2024-09-20T23:30:04.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:04.478 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 podman[133763]: 2024-09-20 23:30:04.046334502 +0000 UTC m=+0.364000594 container init 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70) 2024-09-20T23:30:04.478 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 podman[133763]: 2024-09-20 23:30:04.049897885 +0000 UTC m=+0.367563969 container start 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-20T23:30:04.478 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 podman[133763]: 2024-09-20 23:30:04.138035338 +0000 UTC m=+0.455701430 container attach 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-20T23:30:04.478 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 podman[133763]: 2024-09-20 23:30:04.24456234 +0000 UTC m=+0.562228423 container died 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[111392]: pgmap v263: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[111392]: osdmap e162: 8 total, 7 up, 8 in 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[99281]: pgmap v263: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[99281]: osdmap e162: 8 total, 7 up, 8 in 2024-09-20T23:30:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:05.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 podman[133788]: 2024-09-20 23:30:04.942402976 +0000 UTC m=+0.691112090 container remove 0a2960b15e9b00a6b40a19ac0615438512e45f8eb4e32499124112516f62e82e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-20T23:30:05.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-20T23:30:05.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 systemd[1]: Stopped Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:30:05.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:04 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service: Consumed 13.130s CPU time. 2024-09-20T23:30:05.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 systemd[1]: Starting Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:30:05.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-mon[95499]: pgmap v265: 161 pgs: 19 active+undersized, 10 peering, 6 stale+active+clean, 9 active+undersized+degraded, 117 active+clean; 585 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 29/630 objects degraded (4.603%) 2024-09-20T23:30:05.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-20T23:30:05.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 29/630 objects degraded (4.603%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:05.556 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 podman[133901]: 2024-09-20 23:30:05.293081676 +0000 UTC m=+0.023553000 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:05.556 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 podman[133901]: 2024-09-20 23:30:05.427302227 +0000 UTC m=+0.157773585 container create 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-20T23:30:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[111392]: pgmap v265: 161 pgs: 19 active+undersized, 10 peering, 6 stale+active+clean, 9 active+undersized+degraded, 117 active+clean; 585 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 29/630 objects degraded (4.603%) 2024-09-20T23:30:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-20T23:30:05.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 29/630 objects degraded (4.603%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[99281]: pgmap v265: 161 pgs: 19 active+undersized, 10 peering, 6 stale+active+clean, 9 active+undersized+degraded, 117 active+clean; 585 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 29/630 objects degraded (4.603%) 2024-09-20T23:30:05.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-20T23:30:05.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:05 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 29/630 objects degraded (4.603%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 podman[133901]: 2024-09-20 23:30:05.655348623 +0000 UTC m=+0.385819952 container init 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 podman[133901]: 2024-09-20 23:30:05.658862837 +0000 UTC m=+0.389334156 container start 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 podman[133901]: 2024-09-20 23:30:05.738131698 +0000 UTC m=+0.468603036 container attach 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 bash[133901]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:05.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:05 smithi191 bash[133901]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:05] "GET /metrics HTTP/1.1" 200 38615 "" "Prometheus/2.43.0" 2024-09-20T23:30:07.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:07.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:06 smithi191 bash[133901]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:07.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:07.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:06 smithi191 bash[133901]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:07.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 bash[133901]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 bash[133901]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 bash[133901]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 bash[133901]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[133915]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-20T23:30:07.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 bash[133901]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-20T23:30:07.478 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 podman[133901]: 2024-09-20 23:30:07.191646072 +0000 UTC m=+1.922117390 container died 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-20T23:30:08.122 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:07 smithi191 podman[134045]: 2024-09-20 23:30:07.80886516 +0000 UTC m=+0.610434359 container remove 54cf08adf964d5cf5a0af548f94044dc40e7869a228deac6a6611a50c708cadd (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T23:30:08.122 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 podman[134103]: 2024-09-20 23:30:07.931568049 +0000 UTC m=+0.016307181 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:08.122 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 podman[134103]: 2024-09-20 23:30:08.034988326 +0000 UTC m=+0.119727463 container create ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-20T23:30:08.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:08 smithi170 ceph-mon[99281]: pgmap v266: 161 pgs: 27 active+undersized, 10 peering, 1 stale+active+clean, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:30:08.446 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:08 smithi170 ceph-mon[111392]: pgmap v266: 161 pgs: 27 active+undersized, 10 peering, 1 stale+active+clean, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:30:08.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:08 smithi191 ceph-mon[95499]: pgmap v266: 161 pgs: 27 active+undersized, 10 peering, 1 stale+active+clean, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 53/630 objects degraded (8.413%) 2024-09-20T23:30:08.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 podman[134103]: 2024-09-20 23:30:08.254121617 +0000 UTC m=+0.338860756 container init ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-20T23:30:08.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 podman[134103]: 2024-09-20 23:30:08.257396401 +0000 UTC m=+0.342135533 container start ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-20T23:30:08.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 ceph-osd[134122]: -- 172.21.15.191:0/2329714089 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556965433a40 con 0x5569661fa000 2024-09-20T23:30:08.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 bash[134103]: ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a 2024-09-20T23:30:08.477 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:08 smithi191 systemd[1]: Started Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: pgmap v267: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.670 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: pgmap v267: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.673 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: pgmap v267: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.675 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:09.676 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.208 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:10.131+0000 7f8869b32640 -1 Falling back to public interface 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 18s ago 20m - - 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 14s ago 20m - - 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (10m) 18s ago 15m 27.4M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (9m) 14s ago 15m 53.1M - dad864ee21e9 db20e8680365 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (8m) 18s ago 13m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (9m) 14s ago 20m 527M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (7m) 18s ago 21m 443M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (6m) 18s ago 21m 69.9M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (5m) 14s ago 20m 49.6M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (6m) 18s ago 20m 59.2M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (10m) 18s ago 16m 16.3M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:30:10.362 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (9m) 14s ago 16m 15.1M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 18s ago 19m 54.1M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (3m) 18s ago 19m 51.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (2m) 18s ago 18m 43.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (113s) 18s ago 18m 52.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (30s) 14s ago 18m 43.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 starting - - - 4096M 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (17m) 14s ago 17m 60.6M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (16m) 14s ago 16m 63.1M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (8m) 14s ago 16m 69.5M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (14m) 18s ago 14m 73.8M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (14m) 14s ago 14m 76.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (14m) 18s ago 14m 75.2M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:30:10.363 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (14m) 14s ago 14m 74.2M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='client.74545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='client.54588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:10 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:10.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='client.74545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='client.74545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='client.54588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='client.54588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:10.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:10 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:30:10.775 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 10 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:30:10.776 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:30:11.122 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:30:11.122 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:30:11.122 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:30:11.122 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:30:11.122 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "10/23 daemons upgraded", 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:30:11.123 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: osd.5 (root=default,host=smithi191) is down 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [1,6] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.b is active+undersized+degraded, acting [7,4] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.12 is active+undersized+degraded, acting [3,7] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.14 is active+undersized+degraded, acting [6,3] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.18 is active+undersized+degraded, acting [4,7] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.2 is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.4 is active+undersized+degraded, acting [1,2] 2024-09-20T23:30:11.543 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.5 is active+undersized+degraded, acting [3,2] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.c is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.d is active+undersized+degraded, acting [7,6] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.10 is active+undersized+degraded, acting [6,0] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.16 is active+undersized+degraded, acting [7,1] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.17 is active+undersized+degraded, acting [0,3] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1c is active+undersized+degraded, acting [4,1] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [4,6] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1f is active+undersized+degraded, acting [0,2] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.3 is active+undersized+degraded, acting [0,7] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.15 is active+undersized+degraded, acting [7,3] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.1f is active+undersized+degraded, acting [6,1] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.16 is active+undersized+degraded, acting [3,1] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.c is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:11.544 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.1a is active+undersized+degraded, acting [4,1] 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='client.74557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/107766185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: pgmap v268: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='client.74569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='client.74557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/107766185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='client.74557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/107766185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: pgmap v268: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='client.74569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: pgmap v268: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:11.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='client.74569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:11.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:11.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:11.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1718043881' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.587 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.588 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.589 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1718043881' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1718043881' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:12.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:12.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: pgmap v269: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.716 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.717 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.718 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.719 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.720 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: pgmap v269: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:13.721 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: pgmap v269: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 73/630 objects degraded (11.587%) 2024-09-20T23:30:13.722 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:13.723 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:13.976 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:13.706+0000 7f8869b32640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-20T23:30:13.976 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:13 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:13.740+0000 7f8869b32640 -1 osd.5 160 log_to_monitors true 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:14.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:14.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:14.797 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:14 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:14.733+0000 7f88618dd640 -1 osd.5 160 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: osdmap e163: 8 total, 7 up, 8 in 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: pgmap v271: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: osdmap e163: 8 total, 7 up, 8 in 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: osdmap e163: 8 total, 7 up, 8 in 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: pgmap v271: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: pgmap v271: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.148 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:15] "GET /metrics HTTP/1.1" 200 38623 "" "Prometheus/2.43.0" 2024-09-20T23:30:16.649 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.650 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154] boot 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: osdmap e164: 8 total, 8 up, 8 in 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.651 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154] boot 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: osdmap e164: 8 total, 8 up, 8 in 2024-09-20T23:30:16.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.655 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.656 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: osd.5 [v2:172.21.15.191:6808/660397154,v1:172.21.15.191:6809/660397154] boot 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: osdmap e164: 8 total, 8 up, 8 in 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:16.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:16.734 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: Upgrade: osd.5 is safe to restart 2024-09-20T23:30:17.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: osdmap e165: 8 total, 8 up, 8 in 2024-09-20T23:30:17.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:17 smithi191 ceph-mon[95499]: pgmap v274: 161 pgs: 10 peering, 31 active+undersized, 18 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: Upgrade: osd.5 is safe to restart 2024-09-20T23:30:17.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: osdmap e165: 8 total, 8 up, 8 in 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[111392]: pgmap v274: 161 pgs: 10 peering, 31 active+undersized, 18 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: Upgrade: osd.5 is safe to restart 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: osdmap e165: 8 total, 8 up, 8 in 2024-09-20T23:30:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:17 smithi170 ceph-mon[99281]: pgmap v274: 161 pgs: 10 peering, 31 active+undersized, 18 active+undersized+degraded, 102 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:18.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:18 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:18 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:18.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:18 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:19.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:19 smithi191 ceph-mon[95499]: pgmap v275: 161 pgs: 10 peering, 16 active+undersized, 15 active+undersized+degraded, 120 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 47/630 objects degraded (7.460%) 2024-09-20T23:30:19.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:19 smithi170 ceph-mon[99281]: pgmap v275: 161 pgs: 10 peering, 16 active+undersized, 15 active+undersized+degraded, 120 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 47/630 objects degraded (7.460%) 2024-09-20T23:30:19.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:19 smithi170 ceph-mon[111392]: pgmap v275: 161 pgs: 10 peering, 16 active+undersized, 15 active+undersized+degraded, 120 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 47/630 objects degraded (7.460%) 2024-09-20T23:30:20.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:20 smithi191 ceph-mon[95499]: Upgrade: Updating osd.5 2024-09-20T23:30:20.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:30:20.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:20.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:20.662 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:20 smithi191 ceph-mon[95499]: Deploying daemon osd.5 on smithi191 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[99281]: Upgrade: Updating osd.5 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[99281]: Deploying daemon osd.5 on smithi191 2024-09-20T23:30:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[111392]: Upgrade: Updating osd.5 2024-09-20T23:30:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T23:30:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:20 smithi170 ceph-mon[111392]: Deploying daemon osd.5 on smithi191 2024-09-20T23:30:21.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:21 smithi191 ceph-mon[95499]: pgmap v276: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-20T23:30:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:21 smithi170 ceph-mon[99281]: pgmap v276: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-20T23:30:21.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:21 smithi170 ceph-mon[111392]: pgmap v276: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-20T23:30:22.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:22 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 15 pgs degraded) 2024-09-20T23:30:22.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:22 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:30:22.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.604 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 15 pgs degraded) 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 15 pgs degraded) 2024-09-20T23:30:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:30:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.792 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.792 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.792 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.792 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:23 smithi191 ceph-mon[95499]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[111392]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:23 smithi170 ceph-mon[99281]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-20T23:30:24.153 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:23 smithi191 systemd[1]: Stopping Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:30:24.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:24.151+0000 7f8866aca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:30:24.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:24.151+0000 7f8866aca640 -1 osd.5 165 *** Got signal Terminated *** 2024-09-20T23:30:24.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[134118]: 2024-09-20T23:30:24.151+0000 7f8866aca640 -1 osd.5 165 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:30:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:24 smithi170 ceph-mon[99281]: osd.5 marked itself down and dead 2024-09-20T23:30:24.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:24 smithi170 ceph-mon[111392]: osd.5 marked itself down and dead 2024-09-20T23:30:25.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:24 smithi191 ceph-mon[95499]: osd.5 marked itself down and dead 2024-09-20T23:30:25.529 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:25 smithi191 podman[138185]: 2024-09-20 23:30:25.244882506 +0000 UTC m=+1.207854659 container died ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:25.910 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:25 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:25.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:25 smithi191 ceph-mon[95499]: osdmap e166: 8 total, 7 up, 8 in 2024-09-20T23:30:25.911 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:25 smithi191 ceph-mon[95499]: pgmap v279: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:25.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:25 smithi191 podman[138185]: 2024-09-20 23:30:25.726992863 +0000 UTC m=+1.689965065 container cleanup ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T23:30:25.911 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:25 smithi191 bash[138185]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[99281]: osdmap e166: 8 total, 7 up, 8 in 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[99281]: pgmap v279: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[111392]: osdmap e166: 8 total, 7 up, 8 in 2024-09-20T23:30:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:25 smithi170 ceph-mon[111392]: pgmap v279: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:26.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:25] "GET /metrics HTTP/1.1" 200 38623 "" "Prometheus/2.43.0" 2024-09-20T23:30:26.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138202]: 2024-09-20 23:30:26.045439329 +0000 UTC m=+0.796083587 container remove ba9b8248ee24aab4f375db71b799a804fce4c222f917026ca99101529225af4a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-20T23:30:26.708 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.301129192 +0000 UTC m=+0.015870171 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:26.708 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.421215023 +0000 UTC m=+0.135955978 container create 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-20T23:30:26.708 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.632417223 +0000 UTC m=+0.347158193 container init 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:30:26.708 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.635836808 +0000 UTC m=+0.350577763 container start 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:30:26.709 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.707232843 +0000 UTC m=+0.421973811 container attach 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:26 smithi191 ceph-mon[95499]: osdmap e167: 8 total, 7 up, 8 in 2024-09-20T23:30:26.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:26 smithi191 podman[138289]: 2024-09-20 23:30:26.828218128 +0000 UTC m=+0.542959092 container died 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-20T23:30:27.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:26 smithi170 ceph-mon[99281]: osdmap e167: 8 total, 7 up, 8 in 2024-09-20T23:30:27.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:26 smithi170 ceph-mon[111392]: osdmap e167: 8 total, 7 up, 8 in 2024-09-20T23:30:27.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:27 smithi191 ceph-mon[95499]: pgmap v281: 161 pgs: 8 active+undersized, 16 stale+active+clean, 7 active+undersized+degraded, 130 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 24/630 objects degraded (3.810%) 2024-09-20T23:30:27.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:27 smithi191 podman[138313]: 2024-09-20 23:30:27.57002493 +0000 UTC m=+0.732038030 container remove 4c76f2f86c1f309ccdd76cdfdc0bc2a5f96e9138c37affa4eaf6eaf0ec10cc5d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:30:27.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:27 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-20T23:30:27.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:27 smithi191 systemd[1]: Stopped Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:30:27.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:27 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service: Consumed 1.829s CPU time. 2024-09-20T23:30:27.977 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:27 smithi191 systemd[1]: Starting Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:30:28.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:27 smithi170 ceph-mon[99281]: pgmap v281: 161 pgs: 8 active+undersized, 16 stale+active+clean, 7 active+undersized+degraded, 130 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 24/630 objects degraded (3.810%) 2024-09-20T23:30:28.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:27 smithi170 ceph-mon[111392]: pgmap v281: 161 pgs: 8 active+undersized, 16 stale+active+clean, 7 active+undersized+degraded, 130 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 24/630 objects degraded (3.810%) 2024-09-20T23:30:28.282 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 podman[138412]: 2024-09-20 23:30:27.92869307 +0000 UTC m=+0.016585265 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:28.282 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 podman[138412]: 2024-09-20 23:30:28.071579608 +0000 UTC m=+0.159471795 container create e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 podman[138412]: 2024-09-20 23:30:28.31627474 +0000 UTC m=+0.404166929 container init e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 podman[138412]: 2024-09-20 23:30:28.319765301 +0000 UTC m=+0.407657489 container start e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 podman[138412]: 2024-09-20 23:30:28.399572574 +0000 UTC m=+0.487464765 container attach e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 bash[138412]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:28.727 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:28 smithi191 bash[138412]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 24/630 objects degraded (3.810%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 24/630 objects degraded (3.810%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:29.063 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:29.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:28 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 24/630 objects degraded (3.810%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:29.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:29.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:29.813 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-mon[95499]: pgmap v282: 161 pgs: 29 active+undersized, 5 stale+active+clean, 15 active+undersized+degraded, 112 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:29.814 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-20T23:30:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:29 smithi170 ceph-mon[99281]: pgmap v282: 161 pgs: 29 active+undersized, 5 stale+active+clean, 15 active+undersized+degraded, 112 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-09-20T23:30:29.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:29 smithi170 ceph-mon[111392]: pgmap v282: 161 pgs: 29 active+undersized, 5 stale+active+clean, 15 active+undersized+degraded, 112 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:30.196 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T23:30:30.197 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate[138427]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-20T23:30:30.197 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 bash[138412]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-20T23:30:30.197 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:29 smithi191 podman[138412]: 2024-09-20 23:30:29.840393133 +0000 UTC m=+1.928285324 container died e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:30.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 podman[138570]: 2024-09-20 23:30:30.437194548 +0000 UTC m=+0.590314073 container remove e9b7d14fd17ccaf05e6e426b6c840a88cc5b446e4badffe231db2ccd54fc321c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T23:30:30.917 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:30 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:30.917 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 podman[138629]: 2024-09-20 23:30:30.546742789 +0000 UTC m=+0.016168719 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:30:30.917 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 podman[138629]: 2024-09-20 23:30:30.696659397 +0000 UTC m=+0.166085360 container create 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:30:31.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 podman[138629]: 2024-09-20 23:30:30.916213238 +0000 UTC m=+0.385639173 container init 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-20T23:30:31.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 podman[138629]: 2024-09-20 23:30:30.919608024 +0000 UTC m=+0.389033942 container start 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:30:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:30 smithi191 ceph-osd[138649]: -- 172.21.15.191:0/3517574881 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55896c443a40 con 0x55896d20a400 2024-09-20T23:30:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:31 smithi191 bash[138629]: 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba 2024-09-20T23:30:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:31 smithi191 systemd[1]: Started Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:30:31.242 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:30 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:31.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:30 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: pgmap v283: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: pgmap v283: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: pgmap v283: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:32.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:32.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:32.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:32.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:32.976 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:30:32.809+0000 7f36d5e99640 -1 Falling back to public interface 2024-09-20T23:30:33.266 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.266 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.266 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.266 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.266 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.267 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.268 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.269 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:33.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.461 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.461 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: pgmap v284: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.462 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.463 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.464 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.465 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.466 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.466 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: pgmap v284: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: pgmap v284: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:34.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:34.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.303 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.306 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.307 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.412 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.413 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.414 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.415 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.416 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.417 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.418 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.419 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:35.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:35] "GET /metrics HTTP/1.1" 200 38632 "" "Prometheus/2.43.0" 2024-09-20T23:30:36.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: pgmap v285: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: pgmap v285: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: pgmap v285: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 73/630 objects degraded (11.587%), 22 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:36.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:36 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:36.625 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:30:36.392+0000 7f36d5e99640 -1 osd.5 165 log_to_monitors true 2024-09-20T23:30:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T23:30:37.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:37.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.093 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:30:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:30:37.814+0000 7f36c9c3c640 -1 osd.5 165 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: pgmap v286: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 722 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.398 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: osdmap e168: 8 total, 7 up, 8 in 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.399 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.400 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: pgmap v286: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 722 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:38.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: osdmap e168: 8 total, 7 up, 8 in 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.402 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.403 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.403 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.403 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.403 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' 2024-09-20T23:30:38.404 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.405 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.406 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.407 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.408 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.409 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: pgmap v286: 161 pgs: 37 active+undersized, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 722 B/s rd, 0 op/s; 73/630 objects degraded (11.587%) 2024-09-20T23:30:38.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T23:30:38.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: osdmap e168: 8 total, 7 up, 8 in 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000]' entity='osd.5' 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:38.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.378 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.379 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.380 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.381 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.382 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.383 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000] boot 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: osdmap e169: 8 total, 8 up, 8 in 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.384 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:39.385 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000] boot 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: osdmap e169: 8 total, 8 up, 8 in 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.386 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.420 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.420 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.420 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.420 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.421 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.422 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: osd.5 [v2:172.21.15.191:6808/306034000,v1:172.21.15.191:6809/306034000] boot 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: osdmap e169: 8 total, 8 up, 8 in 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:39.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:39.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:39.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:39.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:39.424 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: pgmap v289: 161 pgs: 8 peering, 30 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:40.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: osdmap e170: 8 total, 8 up, 8 in 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: pgmap v289: 161 pgs: 8 peering, 30 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: pgmap v289: 161 pgs: 8 peering, 30 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: osdmap e170: 8 total, 8 up, 8 in 2024-09-20T23:30:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: osdmap e170: 8 total, 8 up, 8 in 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.364 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.364 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.364 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.364 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 21 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 21 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 21 pgs degraded (PG_DEGRADED) 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:41.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:41.908 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:30:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: pgmap v291: 161 pgs: 18 peering, 23 active+undersized, 13 active+undersized+degraded, 107 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/630 objects degraded (6.508%) 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: pgmap v291: 161 pgs: 18 peering, 23 active+undersized, 13 active+undersized+degraded, 107 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/630 objects degraded (6.508%) 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: pgmap v291: 161 pgs: 18 peering, 23 active+undersized, 13 active+undersized+degraded, 107 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/630 objects degraded (6.508%) 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.369 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:42.370 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 10s ago 21m - - 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 19s ago 21m - - 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (10m) 10s ago 16m 27.5M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (10m) 19s ago 15m 53.2M - dad864ee21e9 db20e8680365 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (9m) 10s ago 14m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (9m) 19s ago 20m 528M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (8m) 10s ago 22m 443M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (7m) 10s ago 22m 74.8M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (6m) 19s ago 20m 54.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (6m) 10s ago 21m 61.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (11m) 10s ago 16m 16.3M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (10m) 19s ago 16m 15.5M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:30:42.591 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 10s ago 20m 56.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (4m) 10s ago 19m 53.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (3m) 10s ago 19m 44.6M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (2m) 10s ago 19m 54.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (62s) 19s ago 18m 45.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 starting - - - 4096M 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (17m) 19s ago 17m 61.0M 4096M 17.2.0 e1d6a67b021e 60f813edbb2e 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (17m) 19s ago 17m 64.1M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (9m) 19s ago 16m 69.5M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (14m) 10s ago 14m 74.1M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (14m) 19s ago 14m 76.7M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (14m) 10s ago 14m 75.5M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:30:42.592 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (14m) 19s ago 14m 74.3M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:30:42.999 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:30:42.999 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-20T23:30:43.000 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 11 2024-09-20T23:30:43.001 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:30:43.001 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:30:43.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:30:42.923+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='client.74590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='client.74596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:43.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:43 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/874480435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.337 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:30:43.337 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "11/23 daemons upgraded", 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:30:43.338 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='client.74590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.339 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='client.74596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.340 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.341 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/874480435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.342 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='client.74590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:43.343 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='client.74596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.344 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.345 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.346 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.346 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:43.346 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:43 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/874480435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN Degraded data redundancy: 41/630 objects degraded (6.508%), 13 pgs degraded 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/630 objects degraded (6.508%), 13 pgs degraded 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [1,6] 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.12 is active+undersized+degraded, acting [3,7] 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.18 is active+undersized+degraded, acting [4,7] 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.2 is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.5 is active+undersized+degraded, acting [3,2] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.c is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.16 is active+undersized+degraded, acting [7,1] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1c is active+undersized+degraded, acting [4,1] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [4,6] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.15 is active+undersized+degraded, acting [7,3] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 5.16 is active+undersized+degraded, acting [3,1] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.c is active+undersized+degraded, acting [3,6] 2024-09-20T23:30:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.1a is active+undersized+degraded, acting [4,1] 2024-09-20T23:30:44.396 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: from='client.74602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: pgmap v292: 161 pgs: 18 peering, 3 active+undersized, 2 active+undersized+degraded, 138 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:44.397 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:44 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/4143706396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: from='client.74602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: pgmap v292: 161 pgs: 18 peering, 3 active+undersized, 2 active+undersized+degraded, 138 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/4143706396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: from='client.74602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: pgmap v292: 161 pgs: 18 peering, 3 active+undersized, 2 active+undersized+degraded, 138 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 6/630 objects degraded (0.952%) 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:44.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:44 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/4143706396' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:30:45.403 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:45 smithi191 ceph-mon[95499]: from='client.74614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:45 smithi170 ceph-mon[99281]: from='client.74614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:45 smithi170 ceph-mon[111392]: from='client.74614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:45.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:45] "GET /metrics HTTP/1.1" 200 38628 "" "Prometheus/2.43.0" 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded) 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded) 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/630 objects degraded (0.952%), 2 pgs degraded) 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:46.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:47.661 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:48 smithi170 ceph-mon[99281]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 495 B/s rd, 0 op/s 2024-09-20T23:30:48.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:48 smithi170 ceph-mon[111392]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 495 B/s rd, 0 op/s 2024-09-20T23:30:48.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:48 smithi191 ceph-mon[95499]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 495 B/s rd, 0 op/s 2024-09-20T23:30:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:50 smithi170 ceph-mon[111392]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-20T23:30:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:50 smithi170 ceph-mon[99281]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-20T23:30:50.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:50 smithi191 ceph-mon[95499]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-20T23:30:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:51 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:51 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:51.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:51 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:30:52.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:52 smithi191 ceph-mon[95499]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-20T23:30:52.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:52 smithi170 ceph-mon[111392]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-20T23:30:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:52 smithi170 ceph-mon[99281]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-20T23:30:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:53 smithi191 ceph-mon[95499]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[99281]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:53 smithi170 ceph-mon[111392]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:30:54.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:54.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:55 smithi170 ceph-mon[99281]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:30:55.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:55 smithi170 ceph-mon[111392]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:30:55.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:55 smithi191 ceph-mon[95499]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:30:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:30:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:30:55] "GET /metrics HTTP/1.1" 200 38628 "" "Prometheus/2.43.0" 2024-09-20T23:30:58.449 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:58 smithi191 ceph-mon[95499]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:58.449 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:58 smithi170 ceph-mon[99281]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:58.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:58 smithi170 ceph-mon[111392]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:30:58.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:59 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:59 smithi191 ceph-mon[95499]: Upgrade: osd.6 is safe to restart 2024-09-20T23:30:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:30:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[99281]: Upgrade: osd.6 is safe to restart 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[111392]: Upgrade: osd.6 is safe to restart 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:30:59.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:30:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: Upgrade: Updating osd.6 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:00.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:00 smithi191 ceph-mon[95499]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: Upgrade: Updating osd.6 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[99281]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:00.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: Upgrade: Updating osd.6 2024-09-20T23:31:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:00.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:00 smithi170 ceph-mon[111392]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:01.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:01 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:01.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:01 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:01.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:01 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:02.363 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:02 smithi191 ceph-mon[95499]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:02.364 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:02 smithi191 systemd[1]: Stopping Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:31:02.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:02 smithi170 ceph-mon[99281]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:02.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:02 smithi170 ceph-mon[111392]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:02.726 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[35199]: 2024-09-20T23:31:02.361+0000 7efd61560700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:31:02.726 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[35199]: 2024-09-20T23:31:02.361+0000 7efd61560700 -1 osd.6 170 *** Got signal Terminated *** 2024-09-20T23:31:02.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:02 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[35199]: 2024-09-20T23:31:02.361+0000 7efd61560700 -1 osd.6 170 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:31:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[99281]: osd.6 marked itself down and dead 2024-09-20T23:31:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[111392]: osd.6 marked itself down and dead 2024-09-20T23:31:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.668 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:03 smithi191 ceph-mon[95499]: osd.6 marked itself down and dead 2024-09-20T23:31:03.669 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.669 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.669 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:03.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:03 smithi191 podman[143983]: 2024-09-20 23:31:03.667738 +0000 UTC m=+1.439039630 container died 60f813edbb2e3f36e3e591100f35cf2d8b4ae09fdaf6855c193eb7bac43c716b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, vcs-type=git, release=754, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, ceph=True, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-20T23:31:04.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:04 smithi191 ceph-mon[95499]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-09-20T23:31:04.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:04 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:04.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:04 smithi191 ceph-mon[95499]: osdmap e171: 8 total, 7 up, 8 in 2024-09-20T23:31:04.423 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:04 smithi191 ceph-mon[95499]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:04.424 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:04 smithi191 podman[143983]: 2024-09-20 23:31:04.170494317 +0000 UTC m=+1.941795988 container cleanup 60f813edbb2e3f36e3e591100f35cf2d8b4ae09fdaf6855c193eb7bac43c716b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, architecture=x86_64, distribution-scope=public, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, vendor=Red Hat, Inc., ceph=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, version=8, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD) 2024-09-20T23:31:04.424 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:04 smithi191 bash[143983]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[99281]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[99281]: osdmap e171: 8 total, 7 up, 8 in 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[99281]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[111392]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 898 B/s rd, 0 op/s 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:04.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[111392]: osdmap e171: 8 total, 7 up, 8 in 2024-09-20T23:31:04.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:04 smithi170 ceph-mon[111392]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:04.700 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:04 smithi191 podman[144061]: 2024-09-20 23:31:04.422263028 +0000 UTC m=+0.750729535 container remove 60f813edbb2e3f36e3e591100f35cf2d8b4ae09fdaf6855c193eb7bac43c716b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, vendor=Red Hat, Inc., version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, distribution-scope=public, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, com.redhat.component=centos-stream-container, release=754, ceph=True, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, name=centos-stream, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:31:04.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:04 smithi191 podman[144104]: 2024-09-20 23:31:04.920791984 +0000 UTC m=+0.470525757 container died b0ab7280ff68278ad2d1c81c1f12baca53aa95a5dfa9d2eb8cdf96db17a20126 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=musing_jemison, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, version=8, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, io.openshift.tags=base centos centos-stream, vcs-type=git, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-20T23:31:05.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:05 smithi170 ceph-mon[99281]: osdmap e172: 8 total, 7 up, 8 in 2024-09-20T23:31:05.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:05 smithi170 ceph-mon[111392]: osdmap e172: 8 total, 7 up, 8 in 2024-09-20T23:31:05.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:05 smithi191 ceph-mon[95499]: osdmap e172: 8 total, 7 up, 8 in 2024-09-20T23:31:06.050 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:05] "GET /metrics HTTP/1.1" 200 38628 "" "Prometheus/2.43.0" 2024-09-20T23:31:06.050 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:05 smithi191 podman[144185]: 2024-09-20 23:31:05.730035635 +0000 UTC m=+0.113295502 container create 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=) 2024-09-20T23:31:06.050 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:05 smithi191 podman[144185]: 2024-09-20 23:31:05.632752984 +0000 UTC m=+0.016012814 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:06.050 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:05 smithi191 podman[144185]: 2024-09-20 23:31:05.957865584 +0000 UTC m=+0.341125422 container init 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-20T23:31:06.050 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:05 smithi191 podman[144185]: 2024-09-20 23:31:05.961443019 +0000 UTC m=+0.344702896 container start 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T23:31:06.051 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 podman[144185]: 2024-09-20 23:31:06.049382651 +0000 UTC m=+0.432642495 container attach 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, ceph=True) 2024-09-20T23:31:06.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:06 smithi191 ceph-mon[95499]: pgmap v305: 161 pgs: 15 peering, 11 stale+active+clean, 135 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:06.391 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:06 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-20T23:31:06.391 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 podman[144185]: 2024-09-20 23:31:06.146189246 +0000 UTC m=+0.529449077 container died 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:31:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:06 smithi170 ceph-mon[99281]: pgmap v305: 161 pgs: 15 peering, 11 stale+active+clean, 135 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:06 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-20T23:31:06.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:06 smithi170 ceph-mon[111392]: pgmap v305: 161 pgs: 15 peering, 11 stale+active+clean, 135 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:06.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:06 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-20T23:31:07.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 podman[144208]: 2024-09-20 23:31:06.812746466 +0000 UTC m=+0.660873186 container remove 895fa78cf0629be6fd59575d68c05c9c9efc855a945be5f1775814a621979db9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux ) 2024-09-20T23:31:07.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service: Deactivated successfully. 2024-09-20T23:31:07.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 systemd[1]: Stopped Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:31:07.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:06 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service: Consumed 11.440s CPU time. 2024-09-20T23:31:07.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 systemd[1]: Starting Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:31:07.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:07 smithi191 ceph-mon[95499]: pgmap v306: 161 pgs: 2 active+undersized, 15 peering, 9 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s; 2/630 objects degraded (0.317%) 2024-09-20T23:31:07.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:07 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:31:07.568 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 podman[144316]: 2024-09-20 23:31:07.157433795 +0000 UTC m=+0.016101082 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:07.568 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 podman[144316]: 2024-09-20 23:31:07.272230057 +0000 UTC m=+0.130897328 container create 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-20T23:31:07.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:07 smithi170 ceph-mon[99281]: pgmap v306: 161 pgs: 2 active+undersized, 15 peering, 9 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s; 2/630 objects degraded (0.317%) 2024-09-20T23:31:07.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:07 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:31:07.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:07 smithi170 ceph-mon[111392]: pgmap v306: 161 pgs: 2 active+undersized, 15 peering, 9 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s; 2/630 objects degraded (0.317%) 2024-09-20T23:31:07.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:07 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 2/630 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED) 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 podman[144316]: 2024-09-20 23:31:07.566899468 +0000 UTC m=+0.425566749 container init 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 podman[144316]: 2024-09-20 23:31:07.570870254 +0000 UTC m=+0.429537535 container start 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 podman[144316]: 2024-09-20 23:31:07.650054917 +0000 UTC m=+0.508722207 container attach 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 bash[144316]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:07.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:07 smithi191 bash[144316]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:08.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:08.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:08.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:08.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:09.088 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[144331]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 bash[144316]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-20T23:31:09.089 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:08 smithi191 podman[144316]: 2024-09-20 23:31:08.799489057 +0000 UTC m=+1.658156339 container died 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-20T23:31:09.714 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:09 smithi191 ceph-mon[95499]: pgmap v307: 161 pgs: 23 active+undersized, 15 peering, 15 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 51/630 objects degraded (8.095%) 2024-09-20T23:31:09.715 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 podman[144476]: 2024-09-20 23:31:09.354193221 +0000 UTC m=+0.548624451 container remove 7249a676e02a170f106c5e7a0757fb55774ec13d8e0952774730864ac51faf99 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:31:09.715 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 podman[144534]: 2024-09-20 23:31:09.465505373 +0000 UTC m=+0.016077479 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:09.715 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 podman[144534]: 2024-09-20 23:31:09.588509339 +0000 UTC m=+0.139081431 container create e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-20T23:31:09.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 podman[144534]: 2024-09-20 23:31:09.833138405 +0000 UTC m=+0.383710509 container init e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:31:09.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 podman[144534]: 2024-09-20 23:31:09.836493532 +0000 UTC m=+0.387065623 container start e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-20T23:31:09.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 ceph-osd[144553]: -- 172.21.15.191:0/1703599902 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b196901a40 con 0x55b1976c8000 2024-09-20T23:31:09.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 bash[144534]: e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 2024-09-20T23:31:09.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:09 smithi191 systemd[1]: Started Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:31:09.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:09 smithi170 ceph-mon[99281]: pgmap v307: 161 pgs: 23 active+undersized, 15 peering, 15 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 51/630 objects degraded (8.095%) 2024-09-20T23:31:09.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:09 smithi170 ceph-mon[111392]: pgmap v307: 161 pgs: 23 active+undersized, 15 peering, 15 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 51/630 objects degraded (8.095%) 2024-09-20T23:31:11.100 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: pgmap v308: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.101 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.102 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.103 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.104 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.105 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:10 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: pgmap v308: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: pgmap v308: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.247 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:11.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:10 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:11.726 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:11.487+0000 7ff35741d640 -1 Falling back to public interface 2024-09-20T23:31:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.085 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.085 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:12.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:12.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: pgmap v309: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: pgmap v309: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.245 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: pgmap v309: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:13.250 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.251 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.252 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:13.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.097 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.246 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.248 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.250 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.251 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 2s ago 22m - - 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 12s ago 21m - - 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (11m) 2s ago 16m 27.5M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (10m) 12s ago 16m 53.6M - dad864ee21e9 db20e8680365 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (9m) 2s ago 15m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (10m) 12s ago 21m 529M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:31:14.783 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (8m) 2s ago 22m 444M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (7m) 2s ago 22m 76.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (6m) 12s ago 21m 53.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (7m) 2s ago 21m 63.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (11m) 2s ago 17m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (10m) 12s ago 17m 15.7M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 2s ago 20m 57.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (4m) 2s ago 20m 55.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (3m) 2s ago 20m 46.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (2m) 2s ago 19m 56.1M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (94s) 12s ago 19m 45.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (44s) 12s ago 18m 52.1M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 starting - - - 4096M 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (18m) 12s ago 18m 64.0M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (9m) 12s ago 17m 66.1M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:31:14.784 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (15m) 2s ago 15m 74.3M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:31:14.785 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (15m) 12s ago 15m 76.9M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:31:14.785 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (15m) 2s ago 15m 75.8M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:31:14.785 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (15m) 12s ago 15m 74.6M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:31:14.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.992 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: pgmap v310: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: pgmap v310: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='client.74626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:14.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.209 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:31:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:31:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:31:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 6 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 11 2024-09-20T23:31:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:31:15.211 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:31:15.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:15.022+0000 7ff35741d640 -1 osd.6 0 read_superblock omap replica is missing. 2024-09-20T23:31:15.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:15.049+0000 7ff35741d640 -1 osd.6 170 log_to_monitors true 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: pgmap v310: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='client.74626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='client.74626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.244 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.245 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.246 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.247 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.248 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:15.249 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:15.599 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:31:15.599 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "11/23 daemons upgraded", 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:31:15.600 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:31:16.026 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: osd.6 (root=default,host=smithi191) is down 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [7,0] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1a is active+undersized+degraded, acting [4,7] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1b is active+undersized+degraded, acting [3,7] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.0 is active+undersized+degraded, acting [1,2] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.a is active+undersized+degraded, acting [4,1] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.c is active+undersized+degraded, acting [5,3] 2024-09-20T23:31:16.027 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.d is active+undersized+degraded, acting [7,5] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.10 is active+undersized+degraded, acting [0,5] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.11 is active+undersized+degraded, acting [7,4] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [5,4] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.1f is active+undersized+degraded, acting [5,1] 2024-09-20T23:31:16.028 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='client.74632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/141196952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.108 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='client.74632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.109 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.110 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/141196952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.111 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.112 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.113 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.114 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.115 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:16 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:16.027+0000 7ff34f1c8640 -1 osd.6 170 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:15] "GET /metrics HTTP/1.1" 200 38626 "" "Prometheus/2.43.0" 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='client.74632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/141196952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:16.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='client.74653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: pgmap v311: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: osdmap e173: 8 total, 7 up, 8 in 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/4287859981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='client.74653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.328 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: pgmap v311: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: osdmap e173: 8 total, 7 up, 8 in 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/4287859981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.329 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.330 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='client.74653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: pgmap v311: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: osdmap e173: 8 total, 7 up, 8 in 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.331 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/4287859981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.332 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.333 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.334 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.335 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:17.337 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664] boot 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: osdmap e174: 8 total, 8 up, 8 in 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664] boot 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: osdmap e174: 8 total, 8 up, 8 in 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: osd.6 [v2:172.21.15.191:6816/2858142664,v1:172.21.15.191:6817/2858142664] boot 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: osdmap e174: 8 total, 8 up, 8 in 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:18.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:18.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: pgmap v314: 161 pgs: 7 peering, 29 active+undersized, 17 active+undersized+degraded, 108 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:31:19.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: osdmap e175: 8 total, 8 up, 8 in 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: pgmap v314: 161 pgs: 7 peering, 29 active+undersized, 17 active+undersized+degraded, 108 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: osdmap e175: 8 total, 8 up, 8 in 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: pgmap v314: 161 pgs: 7 peering, 29 active+undersized, 17 active+undersized+degraded, 108 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 66/630 objects degraded (10.476%) 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: osdmap e175: 8 total, 8 up, 8 in 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:19.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.361 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.363 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.363 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.363 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.363 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:20.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: pgmap v316: 161 pgs: 7 peering, 15 active+undersized, 8 active+undersized+degraded, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.174 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.175 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.177 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:21.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: pgmap v316: 161 pgs: 7 peering, 15 active+undersized, 8 active+undersized+degraded, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: pgmap v316: 161 pgs: 7 peering, 15 active+undersized, 8 active+undersized+degraded, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 28/630 objects degraded (4.444%) 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 66/630 objects degraded (10.476%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:21.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:21.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.228 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.231 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.232 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.233 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.234 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.235 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:22.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.365 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: pgmap v317: 161 pgs: 7 peering, 154 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.366 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.367 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:23.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:23.368 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:23 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 8 pgs degraded) 2024-09-20T23:31:23.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: pgmap v317: 161 pgs: 7 peering, 154 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 8 pgs degraded) 2024-09-20T23:31:23.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: pgmap v317: 161 pgs: 7 peering, 154 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:23.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:31:23.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:23 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/630 objects degraded (4.444%), 8 pgs degraded) 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:24.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:24 smithi191 ceph-mon[95499]: Upgrade: osd.6 is safe to restart 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[99281]: Upgrade: osd.6 is safe to restart 2024-09-20T23:31:24.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:24.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s 2024-09-20T23:31:24.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-20T23:31:24.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:24 smithi170 ceph-mon[111392]: Upgrade: osd.6 is safe to restart 2024-09-20T23:31:26.146 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:25] "GET /metrics HTTP/1.1" 200 38626 "" "Prometheus/2.43.0" 2024-09-20T23:31:26.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:26 smithi191 ceph-mon[95499]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:31:26.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:26 smithi191 ceph-mon[95499]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:26.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[111392]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[111392]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[99281]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:26.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[99281]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:31:26.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.425 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:27.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:28.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:28 smithi191 ceph-mon[95499]: Upgrade: Updating osd.6 2024-09-20T23:31:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:28 smithi191 ceph-mon[95499]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:28.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:28 smithi191 ceph-mon[95499]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[99281]: Upgrade: Updating osd.6 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[99281]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[99281]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[111392]: Upgrade: Updating osd.6 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[111392]: Deploying daemon osd.6 on smithi191 2024-09-20T23:31:28.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:28 smithi170 ceph-mon[111392]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:29.468 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:29.468 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:29.468 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:30.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:30 smithi191 ceph-mon[95499]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:30.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:30 smithi170 ceph-mon[99281]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:30.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:30 smithi170 ceph-mon[111392]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:31.221 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:30 smithi191 systemd[1]: Stopping Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:31:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:31 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:31.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:31.221+0000 7ff3543b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:31:31.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:31.221+0000 7ff3543b5640 -1 osd.6 175 *** Got signal Terminated *** 2024-09-20T23:31:31.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[144549]: 2024-09-20T23:31:31.221+0000 7ff3543b5640 -1 osd.6 175 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:31:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:31 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:31 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:32 smithi191 ceph-mon[95499]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:32 smithi191 ceph-mon[95499]: osd.6 marked itself down and dead 2024-09-20T23:31:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:32 smithi170 ceph-mon[111392]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:32.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:32 smithi170 ceph-mon[111392]: osd.6 marked itself down and dead 2024-09-20T23:31:32.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:32 smithi170 ceph-mon[99281]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-20T23:31:32.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:32 smithi170 ceph-mon[99281]: osd.6 marked itself down and dead 2024-09-20T23:31:32.883 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:32 smithi191 podman[150071]: 2024-09-20 23:31:32.572740091 +0000 UTC m=+1.577835486 container died e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:31:33.224 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:32 smithi191 podman[150071]: 2024-09-20 23:31:32.980233023 +0000 UTC m=+1.985328411 container cleanup e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:31:33.224 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:32 smithi191 bash[150071]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6 2024-09-20T23:31:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:33 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:33 smithi191 ceph-mon[95499]: osdmap e176: 8 total, 7 up, 8 in 2024-09-20T23:31:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150087]: 2024-09-20 23:31:33.281510643 +0000 UTC m=+0.699955922 container remove e8a84eb8ac87ef8b7807cb824a5fb8c9b349a34ead1c2faa39ac02103656e839 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[99281]: osdmap e176: 8 total, 7 up, 8 in 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[111392]: osdmap e176: 8 total, 7 up, 8 in 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:33.903 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150174]: 2024-09-20 23:31:33.550202169 +0000 UTC m=+0.015795237 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:33.903 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150174]: 2024-09-20 23:31:33.657495716 +0000 UTC m=+0.123088761 container create 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True) 2024-09-20T23:31:34.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150174]: 2024-09-20 23:31:33.901985273 +0000 UTC m=+0.367578319 container init 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-20T23:31:34.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150174]: 2024-09-20 23:31:33.905523583 +0000 UTC m=+0.371116630 container start 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-20T23:31:34.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:33 smithi191 podman[150174]: 2024-09-20 23:31:33.9768667 +0000 UTC m=+0.442459746 container attach 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-20T23:31:34.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 podman[150174]: 2024-09-20 23:31:34.098292102 +0000 UTC m=+0.563885148 container died 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T23:31:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:34 smithi170 ceph-mon[111392]: pgmap v325: 161 pgs: 17 peering, 13 stale+active+clean, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 239 B/s rd, 0 op/s 2024-09-20T23:31:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:34 smithi170 ceph-mon[111392]: osdmap e177: 8 total, 7 up, 8 in 2024-09-20T23:31:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:34 smithi170 ceph-mon[99281]: pgmap v325: 161 pgs: 17 peering, 13 stale+active+clean, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 239 B/s rd, 0 op/s 2024-09-20T23:31:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:34 smithi170 ceph-mon[99281]: osdmap e177: 8 total, 7 up, 8 in 2024-09-20T23:31:34.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:34 smithi191 ceph-mon[95499]: pgmap v325: 161 pgs: 17 peering, 13 stale+active+clean, 131 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 239 B/s rd, 0 op/s 2024-09-20T23:31:34.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:34 smithi191 ceph-mon[95499]: osdmap e177: 8 total, 7 up, 8 in 2024-09-20T23:31:35.179 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 podman[150198]: 2024-09-20 23:31:34.739297838 +0000 UTC m=+0.631717425 container remove 79a07fa5f1ff4756f9a907920b045aac151939c54e5b1a6ddc216107e0f43d34 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T23:31:35.179 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service: Deactivated successfully. 2024-09-20T23:31:35.179 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 systemd[1]: Stopped Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:31:35.179 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service: Consumed 1.734s CPU time. 2024-09-20T23:31:35.179 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:34 smithi191 systemd[1]: Starting Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:31:35.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:35 smithi191 ceph-mon[95499]: pgmap v327: 161 pgs: 10 active+undersized, 17 peering, 11 stale+active+clean, 5 active+undersized+degraded, 118 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 26/630 objects degraded (4.127%) 2024-09-20T23:31:35.445 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:35 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 26/630 objects degraded (4.127%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:35.445 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 podman[150298]: 2024-09-20 23:31:35.080600729 +0000 UTC m=+0.015946055 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:35.445 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 podman[150298]: 2024-09-20 23:31:35.225895545 +0000 UTC m=+0.161240856 container create e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:31:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:35 smithi170 ceph-mon[99281]: pgmap v327: 161 pgs: 10 active+undersized, 17 peering, 11 stale+active+clean, 5 active+undersized+degraded, 118 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 26/630 objects degraded (4.127%) 2024-09-20T23:31:35.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:35 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 26/630 objects degraded (4.127%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:35 smithi170 ceph-mon[111392]: pgmap v327: 161 pgs: 10 active+undersized, 17 peering, 11 stale+active+clean, 5 active+undersized+degraded, 118 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 26/630 objects degraded (4.127%) 2024-09-20T23:31:35.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:35 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 26/630 objects degraded (4.127%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:35.726 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 podman[150298]: 2024-09-20 23:31:35.443170661 +0000 UTC m=+0.378515978 container init e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 podman[150298]: 2024-09-20 23:31:35.447304532 +0000 UTC m=+0.382649844 container start e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 podman[150298]: 2024-09-20 23:31:35.526596489 +0000 UTC m=+0.461941814 container attach e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 bash[150298]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:35.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:35 smithi191 bash[150298]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:31:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:35] "GET /metrics HTTP/1.1" 200 38644 "" "Prometheus/2.43.0" 2024-09-20T23:31:36.646 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:36.647 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:36.647 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:36.647 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:36.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate[150314]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 bash[150298]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-20T23:31:36.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:36 smithi191 podman[150298]: 2024-09-20 23:31:36.674997955 +0000 UTC m=+1.610343266 container died e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:31:37.622 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 podman[150456]: 2024-09-20 23:31:37.297456001 +0000 UTC m=+0.616312801 container remove e9b1b3e0fb559fa39ed59838203d601c62700ae9cda247f16f5d9cdc354467f8 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS) 2024-09-20T23:31:37.623 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 podman[150515]: 2024-09-20 23:31:37.410978294 +0000 UTC m=+0.016515452 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:31:37.623 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 podman[150515]: 2024-09-20 23:31:37.51489487 +0000 UTC m=+0.120432019 container create 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T23:31:37.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 podman[150515]: 2024-09-20 23:31:37.733907405 +0000 UTC m=+0.339444560 container init 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-20T23:31:37.976 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 podman[150515]: 2024-09-20 23:31:37.737298838 +0000 UTC m=+0.342835990 container start 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T23:31:37.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 ceph-osd[150534]: -- 172.21.15.191:0/4080216061 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645730fda40 con 0x5645732b4400 2024-09-20T23:31:37.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 bash[150515]: 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c 2024-09-20T23:31:37.977 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:37 smithi191 systemd[1]: Started Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:31:38.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: pgmap v328: 161 pgs: 22 active+undersized, 17 peering, 3 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 52/630 objects degraded (8.254%) 2024-09-20T23:31:38.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.299 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.300 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:38 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: pgmap v328: 161 pgs: 22 active+undersized, 17 peering, 3 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 52/630 objects degraded (8.254%) 2024-09-20T23:31:38.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: pgmap v328: 161 pgs: 22 active+undersized, 17 peering, 3 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 52/630 objects degraded (8.254%) 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:38.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:38.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:38 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:31:39.375+0000 7fc5e900c640 -1 Falling back to public interface 2024-09-20T23:31:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:39.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:39.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:39.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:39.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: pgmap v329: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.293 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.294 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.295 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.296 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.297 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: pgmap v329: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: pgmap v329: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:40.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:40.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:41.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:41.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.440 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: pgmap v330: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 114 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.441 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.442 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: pgmap v330: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 114 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: pgmap v330: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 114 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:42.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:42.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:42.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:42.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:42 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.132 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:31:42.982+0000 7fc5e900c640 -1 osd.6 175 log_to_monitors true 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.399 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.400 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.401 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.402 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:43.502 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:44.614 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:31:44.371+0000 7fc5dcdaf640 -1 osd.6 175 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:31:44.614 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: pgmap v331: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: osdmap e178: 8 total, 7 up, 8 in 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:44 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: pgmap v331: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: pgmap v331: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: osdmap e178: 8 total, 7 up, 8 in 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: osdmap e178: 8 total, 7 up, 8 in 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:31:44.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:44.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:44 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.615 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='osd.6 ' entity='osd.6' 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.616 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.617 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.618 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.619 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='osd.6 ' entity='osd.6' 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='osd.6 ' entity='osd.6' 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:45.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:45.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:45.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.190 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:45] "GET /metrics HTTP/1.1" 200 38649 "" "Prometheus/2.43.0" 2024-09-20T23:31:46.403 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: pgmap v333: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820] boot 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: osdmap e179: 8 total, 8 up, 8 in 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: pgmap v333: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820] boot 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: osdmap e179: 8 total, 8 up, 8 in 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: pgmap v333: 161 pgs: 33 active+undersized, 20 active+undersized+degraded, 108 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:31:46.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: osd.6 [v2:172.21.15.191:6816/2856132820,v1:172.21.15.191:6817/2856132820] boot 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: osdmap e179: 8 total, 8 up, 8 in 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:46.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.085 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:31:47.085 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 14s ago 22m - - 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 0s ago 22m - - 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (11m) 14s ago 17m 27.7M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (11m) 0s ago 17m 52.7M - dad864ee21e9 db20e8680365 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (10m) 14s ago 15m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (10m) 0s ago 21m 531M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (9m) 14s ago 23m 444M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (8m) 14s ago 23m 77.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:31:47.086 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (7m) 0s ago 21m 54.1M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (7m) 14s ago 22m 64.5M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (12m) 14s ago 17m 16.1M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (11m) 0s ago 17m 15.8M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (6m) 14s ago 21m 58.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 14s ago 20m 55.3M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 14s ago 20m 47.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (3m) 14s ago 20m 56.0M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:31:47.087 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (2m) 0s ago 19m 47.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (76s) 0s ago 19m 52.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (37s) 0s ago 18m 42.5M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e8a84eb8ac87 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (18m) 0s ago 18m 65.0M 4096M 17.2.0 e1d6a67b021e a30ccd9b629e 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (10m) 0s ago 17m 66.2M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (16m) 14s ago 16m 74.4M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (15m) 0s ago 15m 77.1M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (15m) 14s ago 15m 75.8M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:31:47.088 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (15m) 0s ago 15m 74.8M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:31:47.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:31:46.948+0000 7f181fc79640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-20T23:31:47.482 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:31:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:31:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 7 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-20T23:31:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 12 2024-09-20T23:31:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:31:47.484 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:31:47.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.484 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: osdmap e180: 8 total, 8 up, 8 in 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.485 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.486 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.487 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: osdmap e180: 8 total, 8 up, 8 in 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.488 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.489 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.490 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.566 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: osdmap e180: 8 total, 8 up, 8 in 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.567 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.568 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:47.569 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:31:47.819 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:31:47.820 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:31:47.820 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "12/23 daemons upgraded", 2024-09-20T23:31:47.820 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:31:47.820 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:31:47.820 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN Degraded data redundancy: 63/630 objects degraded (10.000%), 17 pgs degraded 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 63/630 objects degraded (10.000%), 17 pgs degraded 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [7,0] 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-20T23:31:48.212 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1a is active+undersized+degraded, acting [4,7] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1b is active+undersized+degraded, acting [3,7] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.0 is active+undersized+degraded, acting [1,2] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.a is active+undersized+degraded, acting [4,1] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.c is active+undersized+degraded, acting [5,3] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.d is active+undersized+degraded, acting [7,5] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.10 is active+undersized+degraded, acting [0,5] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.11 is active+undersized+degraded, acting [7,4] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1d is active+undersized+degraded, acting [5,4] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.1f is active+undersized+degraded, acting [5,1] 2024-09-20T23:31:48.213 INFO:teuthology.orchestra.run.smithi170.stdout: pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-20T23:31:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='client.54708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='client.74674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='client.74680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: pgmap v336: 161 pgs: 1 peering, 26 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2782698343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1056873420' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='client.54708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='client.74674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='client.74680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: pgmap v336: 161 pgs: 1 peering, 26 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2782698343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:48 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1056873420' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='client.54708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='client.74674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.633 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='client.74680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: pgmap v336: 161 pgs: 1 peering, 26 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/630 objects degraded (10.000%) 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/2782698343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 63/630 objects degraded (10.000%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T23:31:48.634 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:48 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1056873420' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:31:49.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:49 smithi191 ceph-mon[95499]: from='client.54732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:49.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:49 smithi170 ceph-mon[99281]: from='client.54732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:49.663 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:49 smithi170 ceph-mon[111392]: from='client.54732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:50 smithi191 ceph-mon[95499]: pgmap v337: 161 pgs: 1 peering, 6 active+undersized, 3 active+undersized+degraded, 151 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 15/630 objects degraded (2.381%) 2024-09-20T23:31:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:50 smithi170 ceph-mon[99281]: pgmap v337: 161 pgs: 1 peering, 6 active+undersized, 3 active+undersized+degraded, 151 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 15/630 objects degraded (2.381%) 2024-09-20T23:31:50.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:50 smithi170 ceph-mon[111392]: pgmap v337: 161 pgs: 1 peering, 6 active+undersized, 3 active+undersized+degraded, 151 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 15/630 objects degraded (2.381%) 2024-09-20T23:31:51.328 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:51 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:51.328 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.328 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.328 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:51 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:31:51.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:51.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:51 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:52.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:52 smithi191 ceph-mon[95499]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 706 B/s rd, 0 op/s 2024-09-20T23:31:52.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:52 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/630 objects degraded (2.381%), 3 pgs degraded) 2024-09-20T23:31:52.611 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:52 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[99281]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 706 B/s rd, 0 op/s 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/630 objects degraded (2.381%), 3 pgs degraded) 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[111392]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 706 B/s rd, 0 op/s 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/630 objects degraded (2.381%), 3 pgs degraded) 2024-09-20T23:31:52.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:52 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:31:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:53.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:54.621 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:54 smithi170 ceph-mon[99281]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:54.621 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:54 smithi170 ceph-mon[111392]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:54.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:54 smithi191 ceph-mon[95499]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:55.694 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:55 smithi170 ceph-mon[99281]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:31:55.694 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:55 smithi170 ceph-mon[111392]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:31:55.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:55 smithi191 ceph-mon[95499]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-20T23:31:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:31:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:31:55] "GET /metrics HTTP/1.1" 200 38649 "" "Prometheus/2.43.0" 2024-09-20T23:31:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:58 smithi191 ceph-mon[95499]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 0 op/s 2024-09-20T23:31:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:58.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[99281]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 0 op/s 2024-09-20T23:31:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[111392]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 948 B/s rd, 0 op/s 2024-09-20T23:31:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:31:59.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:59 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:59.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:31:59 smithi170 ceph-mon[99281]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:59.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:59 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:59.674 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:31:59 smithi170 ceph-mon[111392]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:31:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:59 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:31:59.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:31:59 smithi191 ceph-mon[95499]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:32:00.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:00 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:00 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:00 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:01.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:01 smithi191 ceph-mon[95499]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:01.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:01 smithi170 ceph-mon[99281]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:01.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:01 smithi170 ceph-mon[111392]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:02.646 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:02 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.646 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:02 smithi191 ceph-mon[95499]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.646 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:02 smithi191 ceph-mon[95499]: Upgrade: osd.7 is safe to restart 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[99281]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[99281]: Upgrade: osd.7 is safe to restart 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[111392]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-20T23:32:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:02 smithi170 ceph-mon[111392]: Upgrade: osd.7 is safe to restart 2024-09-20T23:32:03.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:03 smithi191 ceph-mon[95499]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:32:03.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:03 smithi170 ceph-mon[99281]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:32:03.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:03 smithi170 ceph-mon[111392]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:32:04.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:04 smithi191 ceph-mon[95499]: Upgrade: Updating osd.7 2024-09-20T23:32:04.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:04 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:04.899 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:32:04.900 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:04 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:04.900 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:04 smithi191 ceph-mon[95499]: Deploying daemon osd.7 on smithi191 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[99281]: Upgrade: Updating osd.7 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[99281]: Deploying daemon osd.7 on smithi191 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[111392]: Upgrade: Updating osd.7 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-20T23:32:04.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:04.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:04 smithi170 ceph-mon[111392]: Deploying daemon osd.7 on smithi191 2024-09-20T23:32:05.791 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:05 smithi191 ceph-mon[95499]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:05.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:05 smithi170 ceph-mon[99281]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:05.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:05 smithi170 ceph-mon[111392]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:32:06.201 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:05] "GET /metrics HTTP/1.1" 200 38643 "" "Prometheus/2.43.0" 2024-09-20T23:32:06.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:06 smithi191 systemd[1]: Stopping Ceph osd.7 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:32:07.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:06 smithi191 ceph-mon[95499]: osd.7 marked itself down and dead 2024-09-20T23:32:07.226 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[38210]: 2024-09-20T23:32:06.829+0000 7efcc13bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:32:07.227 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[38210]: 2024-09-20T23:32:06.829+0000 7efcc13bb700 -1 osd.7 180 *** Got signal Terminated *** 2024-09-20T23:32:07.227 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:06 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[38210]: 2024-09-20T23:32:06.829+0000 7efcc13bb700 -1 osd.7 180 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:32:07.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:06 smithi170 ceph-mon[99281]: osd.7 marked itself down and dead 2024-09-20T23:32:07.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:06 smithi170 ceph-mon[111392]: osd.7 marked itself down and dead 2024-09-20T23:32:07.684 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:07 smithi191 podman[155040]: 2024-09-20 23:32:07.361453926 +0000 UTC m=+0.654267349 container died a30ccd9b629e1fd3eb3a636dd3afe8f382cacdb56227f5cab7e4ae9552c6d569 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, vcs-type=git, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, io.openshift.expose-services=, architecture=x86_64, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container) 2024-09-20T23:32:07.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:07 smithi191 ceph-mon[95499]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:32:07.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:07 smithi191 ceph-mon[95499]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-20T23:32:07.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:07 smithi191 ceph-mon[95499]: osdmap e181: 8 total, 7 up, 8 in 2024-09-20T23:32:07.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:07 smithi191 ceph-mon[95499]: pgmap v347: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:32:07.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:07 smithi191 ceph-mon[95499]: osdmap e182: 8 total, 7 up, 8 in 2024-09-20T23:32:07.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:07 smithi191 podman[155040]: 2024-09-20 23:32:07.865503309 +0000 UTC m=+1.158316715 container cleanup a30ccd9b629e1fd3eb3a636dd3afe8f382cacdb56227f5cab7e4ae9552c6d569 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, version=8, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, ceph=True, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-20T23:32:07.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:07 smithi191 bash[155040]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[99281]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[99281]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[99281]: osdmap e181: 8 total, 7 up, 8 in 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[99281]: pgmap v347: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[99281]: osdmap e182: 8 total, 7 up, 8 in 2024-09-20T23:32:08.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[111392]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T23:32:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[111392]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-20T23:32:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[111392]: osdmap e181: 8 total, 7 up, 8 in 2024-09-20T23:32:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[111392]: pgmap v347: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-20T23:32:08.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:07 smithi170 ceph-mon[111392]: osdmap e182: 8 total, 7 up, 8 in 2024-09-20T23:32:08.466 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155119]: 2024-09-20 23:32:08.109206408 +0000 UTC m=+0.742891114 container remove a30ccd9b629e1fd3eb3a636dd3afe8f382cacdb56227f5cab7e4ae9552c6d569 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, ceph=True, version=8, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, vcs-type=git, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-09-20T23:32:08.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155268]: 2024-09-20 23:32:08.368551407 +0000 UTC m=+0.022973902 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:32:08.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155268]: 2024-09-20 23:32:08.485592462 +0000 UTC m=+0.140014960 container create ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-20T23:32:09.109 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:08 smithi191 ceph-mon[95499]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-09-20T23:32:09.109 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155268]: 2024-09-20 23:32:08.730795327 +0000 UTC m=+0.385217826 container init ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:32:09.109 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155268]: 2024-09-20 23:32:08.734137538 +0000 UTC m=+0.388560042 container start ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70) 2024-09-20T23:32:09.110 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:08 smithi191 podman[155268]: 2024-09-20 23:32:08.83110035 +0000 UTC m=+0.485522848 container attach ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-20T23:32:09.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:08 smithi170 ceph-mon[99281]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-09-20T23:32:09.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:08 smithi170 ceph-mon[111392]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-09-20T23:32:09.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:09 smithi191 podman[155268]: 2024-09-20 23:32:09.265169822 +0000 UTC m=+0.919592320 container died ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70) 2024-09-20T23:32:09.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:09 smithi170 ceph-mon[99281]: pgmap v349: 161 pgs: 19 active+undersized, 16 peering, 10 stale+active+clean, 10 active+undersized+degraded, 106 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 23/630 objects degraded (3.651%) 2024-09-20T23:32:09.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:09 smithi170 ceph-mon[111392]: pgmap v349: 161 pgs: 19 active+undersized, 16 peering, 10 stale+active+clean, 10 active+undersized+degraded, 106 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 23/630 objects degraded (3.651%) 2024-09-20T23:32:10.176 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:09 smithi191 ceph-mon[95499]: pgmap v349: 161 pgs: 19 active+undersized, 16 peering, 10 stale+active+clean, 10 active+undersized+degraded, 106 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 23/630 objects degraded (3.651%) 2024-09-20T23:32:10.735 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 podman[155351]: 2024-09-20 23:32:10.483801974 +0000 UTC m=+1.542211305 container remove ffbbffced0b3486f087a224809b0620d74c99f5011c63da5a22c7bd61bf92279 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70) 2024-09-20T23:32:10.735 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.7.service: Deactivated successfully. 2024-09-20T23:32:10.735 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 systemd[1]: Stopped Ceph osd.7 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:32:10.735 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.7.service: Consumed 13.254s CPU time. 2024-09-20T23:32:10.735 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 systemd[1]: Starting Ceph osd.7 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:32:11.188 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:10 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:11.189 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:10 smithi191 ceph-mon[95499]: Health check failed: Degraded data redundancy: 23/630 objects degraded (3.651%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:11.189 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:10 smithi191 podman[155547]: 2024-09-20 23:32:10.861239708 +0000 UTC m=+0.018321541 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:32:11.189 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 podman[155547]: 2024-09-20 23:32:11.002409736 +0000 UTC m=+0.159491572 container create a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:32:11.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:10 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:11.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:10 smithi170 ceph-mon[99281]: Health check failed: Degraded data redundancy: 23/630 objects degraded (3.651%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:11.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:10 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:11.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:10 smithi170 ceph-mon[111392]: Health check failed: Degraded data redundancy: 23/630 objects degraded (3.651%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:11.720 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 podman[155547]: 2024-09-20 23:32:11.450432687 +0000 UTC m=+0.607514531 container init a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:32:11.720 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 podman[155547]: 2024-09-20 23:32:11.454792495 +0000 UTC m=+0.611874329 container start a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:32:11.720 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 podman[155547]: 2024-09-20 23:32:11.533737819 +0000 UTC m=+0.690819659 container attach a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:32:11.720 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:32:11.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 bash[155547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:32:11.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:32:11.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:11 smithi191 bash[155547]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T23:32:11.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:11 smithi191 ceph-mon[95499]: pgmap v350: 161 pgs: 28 active+undersized, 16 peering, 7 stale+active+clean, 14 active+undersized+degraded, 96 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-09-20T23:32:12.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:11 smithi170 ceph-mon[111392]: pgmap v350: 161 pgs: 28 active+undersized, 16 peering, 7 stale+active+clean, 14 active+undersized+degraded, 96 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-09-20T23:32:12.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:11 smithi170 ceph-mon[99281]: pgmap v350: 161 pgs: 28 active+undersized, 16 peering, 7 stale+active+clean, 14 active+undersized+degraded, 96 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-20T23:32:12.363 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate[155586]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 bash[155547]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-20T23:32:12.721 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 podman[155547]: 2024-09-20 23:32:12.401530718 +0000 UTC m=+1.558612551 container died a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-20T23:32:13.299 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:12 smithi191 podman[155787]: 2024-09-20 23:32:12.996386452 +0000 UTC m=+0.584474878 container remove a350b7174c2da86f12b22ee5ab31428c38b9ba2e4f9e386dabac2bdc43707e4e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:32:13.657 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: pgmap v351: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.658 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:13.658 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 podman[155881]: 2024-09-20 23:32:13.302162333 +0000 UTC m=+0.197160815 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:32:13.658 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 podman[155881]: 2024-09-20 23:32:13.533828295 +0000 UTC m=+0.428826816 container create e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: pgmap v351: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: pgmap v351: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:13.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:13.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 podman[155881]: 2024-09-20 23:32:13.770591036 +0000 UTC m=+0.665589513 container init e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-20T23:32:13.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 podman[155881]: 2024-09-20 23:32:13.773895746 +0000 UTC m=+0.668894222 container start e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-20T23:32:13.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 ceph-osd[155933]: -- 172.21.15.191:0/34450264 <== mon.2 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a3db4da40 con 0x560a3e914400 2024-09-20T23:32:13.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 bash[155881]: e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 2024-09-20T23:32:13.977 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:13 smithi191 systemd[1]: Started Ceph osd.7 for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 6 pgs peering) 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 6 pgs peering) 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 6 pgs peering) 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:14.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.606 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:32:15.423+0000 7ff868c3a640 -1 Falling back to public interface 2024-09-20T23:32:15.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.606 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.607 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.608 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: pgmap v352: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.609 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.610 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: pgmap v352: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: pgmap v352: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:15.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:15.752 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:15 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 81/630 objects degraded (12.857%), 27 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:15] "GET /metrics HTTP/1.1" 200 38725 "" "Prometheus/2.43.0" 2024-09-20T23:32:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.572 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.572 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.572 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.572 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.572 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.573 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.574 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.575 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:16.576 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.717 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: pgmap v353: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: pgmap v353: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: pgmap v353: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.578 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:32:18.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:18.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:18.976 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:32:18.719+0000 7ff868c3a640 -1 osd.7 0 read_superblock omap replica is missing. 2024-09-20T23:32:18.976 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:32:18.780+0000 7ff868c3a640 -1 osd.7 180 log_to_monitors true 2024-09-20T23:32:19.263 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:32:19.263 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 6s ago 23m - - 2024-09-20T23:32:19.263 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 6s ago 22m - - 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (12m) 6s ago 17m 27.7M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (11m) 6s ago 17m 53.6M - dad864ee21e9 db20e8680365 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (11m) 6s ago 16m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (11m) 6s ago 22m 531M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (9m) 6s ago 23m 444M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (9m) 6s ago 24m 79.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (7m) 6s ago 22m 55.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (8m) 6s ago 22m 65.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (12m) 6s ago 18m 16.1M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (11m) 6s ago 18m 15.4M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (6m) 6s ago 21m 59.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:32:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 6s ago 21m 57.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 6s ago 21m 47.7M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (4m) 6s ago 20m 58.7M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (2m) 6s ago 20m 48.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (108s) 6s ago 19m 54.2M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (41s) 6s ago 19m 51.4M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 9007c178854a 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 starting - - - 4096M 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (11m) 6s ago 18m 66.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (16m) 6s ago 16m 74.7M - 17.2.0 e1d6a67b021e 4f534fb83b8a 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (16m) 6s ago 16m 77.2M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (16m) 6s ago 16m 76.0M - 17.2.0 e1d6a67b021e 291c0399dd3e 2024-09-20T23:32:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (16m) 6s ago 16m 74.9M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:19.676 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 7 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 12 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:32:19.677 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='client.74704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='client.54750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.680 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='client.74704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.681 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='client.54750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: pgmap v354: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='client.54759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.685 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: pgmap v354: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='client.54759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.686 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.687 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.708 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='client.74704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.709 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.710 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='client.54750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.711 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: pgmap v354: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 81/630 objects degraded (12.857%) 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='client.54759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.712 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:19.713 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.022 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:32:20.022 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:32:20.023 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "12/23 daemons upgraded", 2024-09-20T23:32:20.024 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T23:32:20.024 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:32:20.024 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:32:20.434 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:32:20.143+0000 7ff85c9dd640 -1 osd.7 180 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 81/630 objects degraded (12.857%), 27 pgs degraded 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: osd.7 (root=default,host=smithi191) is down 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 81/630 objects degraded (12.857%), 27 pgs degraded 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [0,6] 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.9 is active+undersized+degraded, acting [1,3] 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-20T23:32:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.12 is active+undersized+degraded, acting [5,3] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1a is active+undersized+degraded, acting [6,4] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1b is active+undersized+degraded, acting [3,6] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.7 is active+undersized+degraded, acting [3,0] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.8 is active+undersized+degraded, acting [3,1] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.9 is active+undersized+degraded, acting [4,2] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.d is active+undersized+degraded, acting [5,6] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.e is active+undersized+degraded, acting [4,1] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.f is active+undersized+degraded, acting [4,0] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.11 is active+undersized+degraded, acting [4,6] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.12 is active+undersized+degraded, acting [0,3] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.13 is active+undersized+degraded, acting [4,2] 2024-09-20T23:32:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.14 is active+undersized+degraded, acting [4,6] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.15 is active+undersized+degraded, acting [3,4] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.16 is active+undersized+degraded, acting [5,1] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1b is active+undersized+degraded, acting [0,4] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.0 is active+undersized+degraded, acting [3,0] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.3 is active+undersized+degraded, acting [0,5] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.14 is active+undersized+degraded, acting [3,1] 2024-09-20T23:32:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: pg 4.15 is active+undersized+degraded, acting [5,3] 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: osdmap e183: 8 total, 7 up, 8 in 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1488953026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.728 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='client.74731 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='osd.7 ' entity='osd.7' 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: osdmap e183: 8 total, 7 up, 8 in 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1488953026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: osdmap e183: 8 total, 7 up, 8 in 2024-09-20T23:32:20.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1488953026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='client.74731 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='osd.7 ' entity='osd.7' 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='client.74731 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='osd.7 ' entity='osd.7' 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:20.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:20.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.702 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.702 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/4191399901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:21.702 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.702 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.702 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.703 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.704 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.705 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576] boot 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: osdmap e184: 8 total, 8 up, 8 in 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:32:21.706 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: pgmap v357: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.707 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/4191399901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/4191399901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.747 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576] boot 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: osdmap e184: 8 total, 8 up, 8 in 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: pgmap v357: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: osd.7 [v2:172.21.15.191:6824/2825151576,v1:172.21.15.191:6825/2825151576] boot 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: osdmap e184: 8 total, 8 up, 8 in 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: pgmap v357: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:21.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: pgmap v358: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 809 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.522 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all osd 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.523 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.524 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Upgrade: Setting require_osd_release to 19 squid 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: osdmap e185: 8 total, 8 up, 8 in 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all mds 2024-09-20T23:32:22.525 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:22.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: pgmap v358: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 809 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all osd 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.745 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: pgmap v358: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 809 B/s rd, 0 op/s; 81/630 objects degraded (12.857%) 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all osd 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-20T23:32:22.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Upgrade: Setting require_osd_release to 19 squid 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: osdmap e185: 8 total, 8 up, 8 in 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all mds 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T23:32:22.749 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Upgrade: Setting require_osd_release to 19 squid 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.750 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: osdmap e185: 8 total, 8 up, 8 in 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all mds 2024-09-20T23:32:22.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:23 smithi191 ceph-mon[95499]: Health check update: Degraded data redundancy: 48/630 objects degraded (7.619%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:23 smithi170 ceph-mon[99281]: Health check update: Degraded data redundancy: 48/630 objects degraded (7.619%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:23.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:23 smithi170 ceph-mon[111392]: Health check update: Degraded data redundancy: 48/630 objects degraded (7.619%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T23:32:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: pgmap v360: 161 pgs: 7 peering, 28 active+undersized, 15 active+undersized+degraded, 111 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:32:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.foo.smithi170.dfynrq (1/4) 2024-09-20T23:32:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: pgmap v360: 161 pgs: 7 peering, 28 active+undersized, 15 active+undersized+degraded, 111 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.foo.smithi170.dfynrq (1/4) 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:24.897 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:24 smithi191 ceph-mon[95499]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:32:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[99281]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:32:24.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: pgmap v360: 161 pgs: 7 peering, 28 active+undersized, 15 active+undersized+degraded, 111 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 48/630 objects degraded (7.619%) 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.foo.smithi170.dfynrq (1/4) 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi170.dfynrq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:24.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:24 smithi170 ceph-mon[111392]: Deploying daemon rgw.foo.smithi170.dfynrq on smithi170 2024-09-20T23:32:26.197 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:25] "GET /metrics HTTP/1.1" 200 38725 "" "Prometheus/2.43.0" 2024-09-20T23:32:26.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:26 smithi191 ceph-mon[95499]: pgmap v361: 161 pgs: 7 peering, 7 active+undersized, 3 active+undersized+degraded, 144 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 7/630 objects degraded (1.111%) 2024-09-20T23:32:26.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:26 smithi170 ceph-mon[99281]: pgmap v361: 161 pgs: 7 peering, 7 active+undersized, 3 active+undersized+degraded, 144 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 7/630 objects degraded (1.111%) 2024-09-20T23:32:26.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:26 smithi170 ceph-mon[111392]: pgmap v361: 161 pgs: 7 peering, 7 active+undersized, 3 active+undersized+degraded, 144 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 7/630 objects degraded (1.111%) 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/630 objects degraded (1.111%), 3 pgs degraded) 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.854 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:28.969 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/630 objects degraded (1.111%), 3 pgs degraded) 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/630 objects degraded (1.111%), 3 pgs degraded) 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:28.970 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:30.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.smpl.smithi170.ojglvq (2/4) 2024-09-20T23:32:30.309 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.310 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.smpl.smithi170.ojglvq (2/4) 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.311 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.313 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.313 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.313 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.313 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.smpl.smithi170.ojglvq (2/4) 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi170.ojglvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: Deploying daemon rgw.smpl.smithi170.ojglvq on smithi170 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:30.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:31.264 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[99281]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 125 B/s wr, 48 op/s 2024-09-20T23:32:31.264 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[99281]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[111392]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 125 B/s wr, 48 op/s 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[111392]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:32:31.265 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:31 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:32:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:31 smithi191 ceph-mon[95499]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 125 B/s wr, 48 op/s 2024-09-20T23:32:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:31 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:31 smithi191 ceph-mon[95499]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:32:31.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:31 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:32:33.281 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:33 smithi170 ceph-mon[99281]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 104 B/s wr, 74 op/s 2024-09-20T23:32:33.281 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:33 smithi170 ceph-mon[111392]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 104 B/s wr, 74 op/s 2024-09-20T23:32:33.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:33 smithi191 ceph-mon[95499]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 104 B/s wr, 74 op/s 2024-09-20T23:32:34.127 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.127 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.127 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.127 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.128 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:34 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:34.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:34 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:35.100 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[111392]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 91 B/s wr, 91 op/s 2024-09-20T23:32:35.100 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:35.100 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.100 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.100 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:35.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[99281]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 91 B/s wr, 91 op/s 2024-09-20T23:32:35.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:35.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:35 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:35.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-mon[95499]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 91 B/s wr, 91 op/s 2024-09-20T23:32:35.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:35.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:35.347 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:36.200 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:35] "GET /metrics HTTP/1.1" 200 38729 "" "Prometheus/2.43.0" 2024-09-20T23:32:36.201 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:36 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (3/4) 2024-09-20T23:32:36.201 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:36 smithi191 ceph-mon[95499]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:36 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (3/4) 2024-09-20T23:32:36.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:36 smithi170 ceph-mon[99281]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:36 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (3/4) 2024-09-20T23:32:36.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:36 smithi170 ceph-mon[111392]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:37.227 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:37 smithi170 ceph-mon[111392]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 172 B/s wr, 119 op/s 2024-09-20T23:32:37.227 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:37 smithi170 ceph-mon[99281]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 172 B/s wr, 119 op/s 2024-09-20T23:32:37.382 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:37 smithi191 ceph-mon[95499]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 172 B/s wr, 119 op/s 2024-09-20T23:32:39.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 172 B/s wr, 142 op/s 2024-09-20T23:32:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:39 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 172 B/s wr, 142 op/s 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 172 B/s wr, 142 op/s 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:39.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:39 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 259 B/s wr, 172 op/s 2024-09-20T23:32:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (4/4) 2024-09-20T23:32:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:41.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[111392]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 259 B/s wr, 172 op/s 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (4/4) 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:41.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:41 smithi170 ceph-mon[99281]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 259 B/s wr, 172 op/s 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (4/4) 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:41.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:41 smithi191 ceph-mon[95499]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:32:43.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:43 smithi191 ceph-mon[95499]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 170 B/s wr, 165 op/s 2024-09-20T23:32:43.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:43 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:43.362 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[111392]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 170 B/s wr, 165 op/s 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[99281]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 170 B/s wr, 165 op/s 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 175 op/s 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.316 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: Checking dashboard <-> RGW credentials 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 175 op/s 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: Checking dashboard <-> RGW credentials 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 175 op/s 2024-09-20T23:32:45.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: Checking dashboard <-> RGW credentials 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:45.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:45.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:45 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:45.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:45] "GET /metrics HTTP/1.1" 200 38756 "" "Prometheus/2.43.0" 2024-09-20T23:32:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.481 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.482 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:46.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:46.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 183 op/s 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 183 op/s 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 183 op/s 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:47.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.478 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.479 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.480 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:48 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.495 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.500 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:48.501 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:48 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.406 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 85 B/s wr, 174 op/s 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.408 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.409 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.412 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.413 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.414 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:49 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 85 B/s wr, 174 op/s 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.497 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 85 B/s wr, 174 op/s 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.500 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.501 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.502 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.503 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.504 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.505 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.506 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.507 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.508 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:49.509 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:49.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:49.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:49.510 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:49 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.385 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.386 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.387 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.388 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:50 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.494 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.496 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.497 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.498 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.499 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:50 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:50.792 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:32:51.236 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[99281]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 170 B/s wr, 197 op/s 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 12s ago 23m - - 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 1s ago 23m - - 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (12m) 12s ago 18m 27.7M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (12m) 1s ago 18m 51.7M - dad864ee21e9 db20e8680365 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (11m) 12s ago 16m 62.5M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (11m) 1s ago 22m 533M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (10m) 12s ago 24m 444M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:32:51.439 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (9m) 12s ago 24m 81.3M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (8m) 1s ago 23m 58.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (8m) 12s ago 23m 67.7M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (13m) 12s ago 18m 16.7M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (12m) 1s ago 18m 15.4M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 12s ago 22m 60.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 12s ago 22m 58.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 12s ago 21m 48.9M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (4m) 12s ago 21m 59.7M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (3m) 1s ago 20m 53.1M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (2m) 1s ago 20m 57.1M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (74s) 1s ago 20m 53.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 9007c178854a 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (38s) 1s ago 19m 54.8M 4096M 19.1.1-367-g9e2ac70b cc9251b744a3 e1a3a02f75ee 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (11m) 1s ago 19m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (24s) 12s ago 17m 77.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 5f74ecbe7665 2024-09-20T23:32:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (17m) 1s ago 17m 77.5M - 17.2.0 e1d6a67b021e 5a9caade505b 2024-09-20T23:32:51.441 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (18s) 12s ago 16m - - 19.1.1-367-g9e2ac70b cc9251b744a3 b872b6a2fdae 2024-09-20T23:32:51.441 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (16m) 1s ago 16m 75.2M - 17.2.0 e1d6a67b021e 349e84da4f81 2024-09-20T23:32:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:51 smithi191 ceph-mon[95499]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 170 B/s wr, 197 op/s 2024-09-20T23:32:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:51 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:51 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[111392]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 129 KiB/s rd, 170 B/s wr, 197 op/s 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:32:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:51 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:32:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 17 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:32:51.832 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:32:52.166 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:32:52.166 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "osd" 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "17/23 daemons upgraded", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading rgw daemons", 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:32:52.167 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='client.74851 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/2307286647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='client.74851 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/2307286647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.565 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:32:52.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='client.74851 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/2307286647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:32:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:52.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:53.443 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 85 B/s wr, 168 op/s 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='client.74863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='client.74875 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1298968386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.444 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:53 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 85 B/s wr, 168 op/s 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='client.74863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='client.74875 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1298968386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 85 B/s wr, 168 op/s 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='client.74863 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='client.74875 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1298968386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:32:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi191.hyqqaq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:32:53.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:53 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:54 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (1/2) 2024-09-20T23:32:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:54 smithi191 ceph-mon[95499]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:54 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (1/2) 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[99281]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.foo.smithi191.hyqqaq (1/2) 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[111392]: Deploying daemon rgw.foo.smithi191.hyqqaq on smithi191 2024-09-20T23:32:54.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:54.744 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:54 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:55.472 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:55 smithi170 ceph-mon[99281]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 85 B/s wr, 141 op/s 2024-09-20T23:32:55.473 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:55 smithi170 ceph-mon[111392]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 85 B/s wr, 141 op/s 2024-09-20T23:32:55.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:55 smithi191 ceph-mon[95499]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 85 B/s wr, 141 op/s 2024-09-20T23:32:56.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:32:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:32:55] "GET /metrics HTTP/1.1" 200 38756 "" "Prometheus/2.43.0" 2024-09-20T23:32:57.315 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:57 smithi170 ceph-mon[99281]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 102 op/s 2024-09-20T23:32:57.315 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:57 smithi170 ceph-mon[111392]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 102 op/s 2024-09-20T23:32:57.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:57 smithi191 ceph-mon[95499]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 85 B/s wr, 102 op/s 2024-09-20T23:32:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[99281]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 85 B/s wr, 70 op/s 2024-09-20T23:32:58.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[111392]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 85 B/s wr, 70 op/s 2024-09-20T23:32:58.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:32:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:32:58.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:32:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:58 smithi191 ceph-mon[95499]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 85 B/s wr, 70 op/s 2024-09-20T23:32:58.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:32:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:00.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:00 smithi191 ceph-mon[95499]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-09-20T23:33:00.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:00 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:00 smithi170 ceph-mon[99281]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-09-20T23:33:00.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:00 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:00 smithi170 ceph-mon[111392]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-09-20T23:33:00.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:00 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:02.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:02 smithi191 ceph-mon[95499]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:02.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:02 smithi170 ceph-mon[99281]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:02.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:02 smithi170 ceph-mon[111392]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:04.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:04 smithi191 ceph-mon[95499]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:04.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:04 smithi170 ceph-mon[99281]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:04.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:04 smithi170 ceph-mon[111392]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:05] "GET /metrics HTTP/1.1" 200 38790 "" "Prometheus/2.43.0" 2024-09-20T23:33:06.637 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:06 smithi191 ceph-mon[95499]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:06.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:06 smithi170 ceph-mon[99281]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:06.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:06 smithi170 ceph-mon[111392]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:09.229 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:09 smithi191 ceph-mon[95499]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:09.230 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:09 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[99281]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[111392]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:09 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:11.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 85 B/s wr, 24 op/s 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (2/2) 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:11.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:11 smithi191 ceph-mon[95499]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 85 B/s wr, 24 op/s 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (2/2) 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[99281]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 85 B/s wr, 24 op/s 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: Upgrade: Updating rgw.smpl.smithi191.blxmkg (2/2) 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi191.blxmkg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:11.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:11 smithi170 ceph-mon[111392]: Deploying daemon rgw.smpl.smithi191.blxmkg on smithi191 2024-09-20T23:33:13.430 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:13 smithi191 ceph-mon[95499]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 85 B/s wr, 52 op/s 2024-09-20T23:33:13.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:13 smithi170 ceph-mon[99281]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 85 B/s wr, 52 op/s 2024-09-20T23:33:13.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:13 smithi170 ceph-mon[111392]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 85 B/s wr, 52 op/s 2024-09-20T23:33:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:14 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:14.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:14 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:14.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:14 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:15.453 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:15 smithi191 ceph-mon[95499]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:15.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:15 smithi170 ceph-mon[99281]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:15.455 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:15 smithi170 ceph-mon[111392]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:16.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:15] "GET /metrics HTTP/1.1" 200 38775 "" "Prometheus/2.43.0" 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 100 B/s wr, 99 op/s 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.629 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[111392]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 100 B/s wr, 99 op/s 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:16 smithi170 ceph-mon[99281]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:33:16.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-09-20T23:33:16.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 100 B/s wr, 99 op/s 2024-09-20T23:33:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:16.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:16 smithi191 ceph-mon[95499]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.744 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Adjusting osd_memory_target on smithi170 to 2480M 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Adjusting osd_memory_target on smithi191 to 2736M 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.745 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 109 B/s wr, 108 op/s 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.746 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.747 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Adjusting osd_memory_target on smithi170 to 2480M 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Adjusting osd_memory_target on smithi191 to 2736M 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 109 B/s wr, 108 op/s 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.748 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Checking dashboard <-> RGW credentials 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.749 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.750 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.751 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Checking dashboard <-> RGW credentials 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.752 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.753 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.754 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:17 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.825 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Adjusting osd_memory_target on smithi170 to 2480M 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Adjusting osd_memory_target on smithi191 to 2736M 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.826 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 109 B/s wr, 108 op/s 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Checking dashboard <-> RGW credentials 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.827 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.828 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:17.829 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:17 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.779 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Cluster is now healthy 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.780 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.781 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.782 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:18 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Cluster is now healthy 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-20T23:33:18.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Cluster is now healthy 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:18.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:18.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:18 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:19 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:19.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.004 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.005 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.006 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:19 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:20 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:20.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:20 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 109 B/s wr, 121 op/s 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.731 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.732 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.733 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:21 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 109 B/s wr, 121 op/s 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 109 B/s wr, 121 op/s 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:21.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:21 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.930 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:22 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:22.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:22 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.613 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 6s ago 24m - - 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 8s ago 23m - - 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (13m) 6s ago 18m 27.8M - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (12m) 8s ago 18m 51.8M - dad864ee21e9 db20e8680365 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (12m) 6s ago 17m 62.6M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (12m) 8s ago 23m 534M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (10m) 6s ago 24m 445M - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (10m) 6s ago 25m 83.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (8m) 8s ago 23m 59.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (9m) 6s ago 23m 68.8M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (13m) 6s ago 19m 16.2M - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (13m) 8s ago 19m 15.5M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 6s ago 22m 62.7M 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:33:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 6s ago 22m 61.5M 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 6s ago 22m 51.4M 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (5m) 6s ago 21m 62.9M 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (3m) 8s ago 21m 55.3M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (2m) 8s ago 20m 58.0M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (106s) 8s ago 20m 55.8M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 9007c178854a 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (70s) 8s ago 20m 56.3M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 e1a3a02f75ee 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (12m) 8s ago 19m 67.4M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (56s) 6s ago 17m 77.8M - 19.1.1-367-g9e2ac70b cc9251b744a3 5f74ecbe7665 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (16s) 8s ago 17m 77.7M - 19.1.1-367-g9e2ac70b cc9251b744a3 1da78d577d0e 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (50s) 6s ago 17m 75.4M - 19.1.1-367-g9e2ac70b cc9251b744a3 b872b6a2fdae 2024-09-20T23:33:23.615 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 starting - - - - 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 109 B/s wr, 110 op/s 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.919 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='client.74959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.920 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.921 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='client.74965 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.922 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:23 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 109 B/s wr, 110 op/s 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='client.74959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 109 B/s wr, 110 op/s 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='client.74959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='client.74965 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:23.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='client.74965 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:23 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:33:24.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 18 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:33:24.045 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "osd" 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T23:33:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading rgw daemons", 2024-09-20T23:33:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-20T23:33:24.397 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:33:24.824 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_OK 2024-09-20T23:33:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='client.55023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/904421256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.982 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.983 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.984 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:24 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='client.55023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/904421256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='client.55023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/904421256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:24.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.002 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:24 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:25] "GET /metrics HTTP/1.1" 200 38775 "" "Prometheus/2.43.0" 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='client.74983 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 109 B/s wr, 111 op/s 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1996391679' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.981 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:25 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='client.74983 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 109 B/s wr, 111 op/s 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1996391679' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='client.74983 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 109 B/s wr, 111 op/s 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:25.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1996391679' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.003 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.003 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.004 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.005 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.006 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.007 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.008 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.009 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.011 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.012 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:25 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:26 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:26.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:26 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 92 B/s wr, 93 op/s 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:27 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 92 B/s wr, 93 op/s 2024-09-20T23:33:27.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 92 B/s wr, 93 op/s 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.996 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.997 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:27.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:27 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.978 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.979 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.980 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:28 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:28.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:28 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.718 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:29 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-09-20T23:33:29.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:29.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.000 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.001 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.002 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:29 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.719 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.720 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.721 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.722 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.723 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:30 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:30.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:30.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.000 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:31.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:31.001 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:30 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.873 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.873 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 58 op/s 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.874 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all rgw 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]': finished 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]': finished 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]': finished 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]': finished 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.875 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:31 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 58 op/s 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all rgw 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]': finished 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]': finished 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]': finished 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 85 B/s wr, 58 op/s 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.996 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all rgw 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi170.dfynrq"}]': finished 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi191.hyqqaq"}]': finished 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]: dispatch 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi170.ojglvq"}]': finished 2024-09-20T23:33:31.997 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]': finished 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.998 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]: dispatch 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi191.blxmkg"}]': finished 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:31.999 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:31 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: Upgrade: Updating iscsi.foo.smithi170.ykmvuq 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:33:33.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:33 smithi191 ceph-mon[95499]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: Upgrade: Updating iscsi.foo.smithi170.ykmvuq 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[99281]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: Upgrade: Updating iscsi.foo.smithi170.ykmvuq 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:33.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi170.ykmvuq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-20T23:33:33.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:33.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: Deploying daemon iscsi.foo.smithi170.ykmvuq on smithi170 2024-09-20T23:33:33.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:33 smithi170 ceph-mon[111392]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-20T23:33:35.804 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:35 smithi170 ceph-mon[99281]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:35.804 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:35 smithi170 ceph-mon[111392]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:36.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:35 smithi191 ceph-mon[95499]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:36.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:35] "GET /metrics HTTP/1.1" 200 38777 "" "Prometheus/2.43.0" 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[99281]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[111392]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:37.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:37.995 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:37 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:38.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:37 smithi191 ceph-mon[95499]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:38.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:38.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:38.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:37 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:40.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:39 smithi191 ceph-mon[95499]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:40.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:39 smithi170 ceph-mon[99281]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:40.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:39 smithi170 ceph-mon[111392]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:41.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:40 smithi191 ceph-mon[95499]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:40 smithi170 ceph-mon[99281]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:41.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:40 smithi170 ceph-mon[111392]: from='client.25432 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:33:42.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:41 smithi191 ceph-mon[95499]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:42.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:41 smithi170 ceph-mon[99281]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:42.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:41 smithi170 ceph-mon[111392]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:44.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:43 smithi191 ceph-mon[95499]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:44.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:43 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:44.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:43 smithi170 ceph-mon[99281]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:44.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:43 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:44.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:43 smithi170 ceph-mon[111392]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:33:44.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:43 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:46.029 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:45 smithi191 ceph-mon[95499]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:46.029 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:45] "GET /metrics HTTP/1.1" 200 38789 "" "Prometheus/2.43.0" 2024-09-20T23:33:46.029 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:33:45.938+0000 7f1811bdd640 -1 log_channel(cephadm) log [ERR] : Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:33:46.053 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:45 smithi170 ceph-mon[99281]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:46.053 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:45 smithi170 ceph-mon[111392]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.153 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.154 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:46 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:47.210 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:46 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:47.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:47 smithi170 ceph-mon[99281]: Health check failed: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-20T23:33:47.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:47 smithi170 ceph-mon[111392]: Health check failed: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-20T23:33:48.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:47 smithi191 ceph-mon[95499]: Health check failed: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-20T23:33:49.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:48 smithi191 ceph-mon[95499]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:49.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:48 smithi170 ceph-mon[99281]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:49.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:48 smithi170 ceph-mon[111392]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 0 op/s 2024-09-20T23:33:51.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:50 smithi191 ceph-mon[95499]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:51.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:50 smithi170 ceph-mon[99281]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:51.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:50 smithi170 ceph-mon[111392]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:52.339 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.339 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.339 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:52.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:53.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:53 smithi191 ceph-mon[95499]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:53.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:53 smithi170 ceph-mon[99281]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:53.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:53 smithi170 ceph-mon[111392]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:55.221 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:33:55.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:55 smithi170 ceph-mon[99281]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:55.461 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:55 smithi170 ceph-mon[111392]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:55.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:55 smithi191 ceph-mon[95499]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-09-20T23:33:55.567 INFO:teuthology.orchestra.run.smithi170.stdout:"Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed." 2024-09-20T23:33:56.145 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ps' 2024-09-20T23:33:56.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:56 smithi191 ceph-mon[95499]: from='client.74995 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:33:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:33:55] "GET /metrics HTTP/1.1" 200 38789 "" "Prometheus/2.43.0" 2024-09-20T23:33:56.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:56 smithi170 ceph-mon[99281]: from='client.74995 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:56.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:56 smithi170 ceph-mon[111392]: from='client.74995 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:57.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:57 smithi191 ceph-mon[95499]: from='client.55053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:57.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:57 smithi191 ceph-mon[95499]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 182 B/s rd, 0 op/s 2024-09-20T23:33:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:57 smithi170 ceph-mon[99281]: from='client.55053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:57 smithi170 ceph-mon[99281]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 182 B/s rd, 0 op/s 2024-09-20T23:33:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:57 smithi170 ceph-mon[111392]: from='client.55053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:57 smithi170 ceph-mon[111392]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 182 B/s rd, 0 op/s 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 0s ago 24m - - 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 7s ago 24m - - 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (14m) 0s ago 19m - - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (13m) 7s ago 19m 52.5M - dad864ee21e9 db20e8680365 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (12m) 0s ago 17m 62.6M - 3.5 e1d6a67b021e 45fbab4c74e4 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (12m) 7s ago 23m 535M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (11m) 0s ago 25m - - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:33:58.334 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (10m) 0s ago 25m - 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (9m) 7s ago 24m 62.0M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (9m) 0s ago 24m - 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (14m) 0s ago 19m - - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (13m) 7s ago 19m 15.5M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 0s ago 23m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (7m) 0s ago 23m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (6m) 0s ago 22m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (5m) 0s ago 22m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (4m) 7s ago 21m 58.4M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (3m) 7s ago 21m 59.8M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (2m) 7s ago 21m 57.6M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 9007c178854a 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (105s) 7s ago 20m 58.4M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 e1a3a02f75ee 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (12m) 7s ago 20m 69.1M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (91s) 0s ago 18m - - 19.1.1-367-g9e2ac70b cc9251b744a3 5f74ecbe7665 2024-09-20T23:33:58.335 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (50s) 7s ago 18m 78.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 1da78d577d0e 2024-09-20T23:33:58.336 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (85s) 0s ago 17m - - 19.1.1-367-g9e2ac70b cc9251b744a3 b872b6a2fdae 2024-09-20T23:33:58.336 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (42s) 7s ago 17m 76.2M - 19.1.1-367-g9e2ac70b cc9251b744a3 02a9431eca43 2024-09-20T23:33:58.911 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.912 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:58 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:58.936 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions' 2024-09-20T23:33:58.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:33:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:33:58.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:58 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:33:59.851 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:33:59 smithi170 ceph-mon[99281]: from='client.75007 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:59.851 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:33:59 smithi170 ceph-mon[111392]: from='client.75007 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:59.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:33:59 smithi191 ceph-mon[95499]: from='client.75007 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:00.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:00 smithi170 ceph-mon[99281]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:34:00.965 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:00 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3562565946' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:34:00.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:00 smithi170 ceph-mon[111392]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:34:00.966 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:00 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3562565946' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:34:00.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:00 smithi191 ceph-mon[95499]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-09-20T23:34:00.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:00 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3562565946' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-20T23:34:02.049 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 5 2024-09-20T23:34:02.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:34:02.051 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:34:02.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 18 2024-09-20T23:34:02.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:34:02.051 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:34:02.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[99281]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3438854183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[111392]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:34:03.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3438854183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:34:03.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:03 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:03 smithi191 ceph-mon[95499]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail 2024-09-20T23:34:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:03 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3438854183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:34:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:03.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:03 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:05.217 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:05 smithi170 ceph-mon[99281]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:05.217 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:05 smithi170 ceph-mon[111392]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:05.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:05 smithi191 ceph-mon[95499]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:05] "GET /metrics HTTP/1.1" 200 38871 "" "Prometheus/2.43.0" 2024-09-20T23:34:06.441 INFO:teuthology.orchestra.run.smithi170.stdout:wait for servicemap items w/ changing names to refresh 2024-09-20T23:34:07.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:07 smithi170 ceph-mon[99281]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:07.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:07 smithi170 ceph-mon[111392]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:07.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'sleep 60' 2024-09-20T23:34:07.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:07 smithi191 ceph-mon[95499]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:09.079 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:09 smithi170 ceph-mon[99281]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:09.079 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:09 smithi170 ceph-mon[111392]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:09 smithi191 ceph-mon[95499]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-20T23:34:11.281 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:11 smithi191 ceph-mon[95499]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:11.281 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:11 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:11 smithi170 ceph-mon[99281]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:11.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:11 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:11 smithi170 ceph-mon[111392]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:11.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:11 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:12.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.407 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:12.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:13.603 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:13 smithi191 ceph-mon[95499]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:13.603 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:13 smithi170 ceph-mon[99281]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:13.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:13.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:13 smithi170 ceph-mon[111392]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-20T23:34:13.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:15.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:15 smithi191 ceph-mon[95499]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:15.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:15 smithi170 ceph-mon[99281]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:15.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:15 smithi170 ceph-mon[111392]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:15] "GET /metrics HTTP/1.1" 200 38867 "" "Prometheus/2.43.0" 2024-09-20T23:34:17.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:17 smithi170 ceph-mon[99281]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:17.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:17 smithi170 ceph-mon[111392]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:17.675 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:17 smithi191 ceph-mon[95499]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:19.410 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:19 smithi170 ceph-mon[99281]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:19.410 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:19 smithi170 ceph-mon[111392]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:19.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:19 smithi191 ceph-mon[95499]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:20.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.726 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:20 smithi191 ceph-mon[95499]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:20.727 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:20 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[99281]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[111392]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:20.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:20 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:23.269 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:23 smithi170 ceph-mon[99281]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:23.269 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:23 smithi170 ceph-mon[111392]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:23.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:23 smithi191 ceph-mon[95499]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:25.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:25 smithi191 ceph-mon[95499]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:25.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:25 smithi170 ceph-mon[99281]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:25.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:25 smithi170 ceph-mon[111392]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:26.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:25] "GET /metrics HTTP/1.1" 200 38867 "" "Prometheus/2.43.0" 2024-09-20T23:34:27.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:27 smithi191 ceph-mon[95499]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:27.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:27 smithi170 ceph-mon[99281]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:27.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:27 smithi170 ceph-mon[111392]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:29.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:29 smithi191 ceph-mon[95499]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:29.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:29 smithi170 ceph-mon[99281]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:29.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:29 smithi170 ceph-mon[111392]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:29.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:31.410 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:31 smithi191 ceph-mon[95499]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.411 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:31 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:31 smithi170 ceph-mon[99281]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:31 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:31 smithi170 ceph-mon[111392]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:31 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:32.541 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.541 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.541 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.541 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:32 smithi191 ceph-mon[95499]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[99281]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:32.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:32 smithi170 ceph-mon[111392]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:35.447 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:35 smithi170 ceph-mon[99281]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:35.447 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:35 smithi170 ceph-mon[111392]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:35.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:35 smithi191 ceph-mon[95499]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:36.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:35] "GET /metrics HTTP/1.1" 200 38873 "" "Prometheus/2.43.0" 2024-09-20T23:34:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:37 smithi191 ceph-mon[95499]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:37.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:37 smithi170 ceph-mon[99281]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:37.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:37 smithi170 ceph-mon[111392]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:39.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:39 smithi170 ceph-mon[99281]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:39.293 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:39 smithi170 ceph-mon[111392]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:39 smithi191 ceph-mon[95499]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:40.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[99281]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:40.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:40.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[111392]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:40.875 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:40 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:40.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:40 smithi191 ceph-mon[95499]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:40.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:40 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:43.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:43 smithi191 ceph-mon[95499]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:43.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:43 smithi170 ceph-mon[99281]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:43.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:43 smithi170 ceph-mon[111392]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:44.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:44 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:44.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:44 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:44.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:44 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:45.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:45 smithi191 ceph-mon[95499]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:45.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:45 smithi170 ceph-mon[99281]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:45.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:45 smithi170 ceph-mon[111392]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:45.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:45] "GET /metrics HTTP/1.1" 200 38871 "" "Prometheus/2.43.0" 2024-09-20T23:34:47.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:47 smithi191 ceph-mon[95499]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:47.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:47 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:47.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:47 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[99281]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[111392]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:47.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:47.494 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:47 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:49.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:49 smithi191 ceph-mon[95499]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:49.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:49 smithi170 ceph-mon[99281]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:49.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:49 smithi170 ceph-mon[111392]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:51 smithi191 ceph-mon[95499]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:51.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:51 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:51 smithi170 ceph-mon[99281]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:51.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:51 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:51 smithi170 ceph-mon[111392]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:51.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:51 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:34:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.729 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:52 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:52 smithi191 ceph-mon[95499]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[99281]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:34:52.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:52 smithi170 ceph-mon[111392]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:55.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:55 smithi191 ceph-mon[95499]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:55.492 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:55 smithi170 ceph-mon[111392]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:55.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:55 smithi170 ceph-mon[99281]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:56.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:34:55 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:34:55] "GET /metrics HTTP/1.1" 200 38871 "" "Prometheus/2.43.0" 2024-09-20T23:34:57.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:57 smithi191 ceph-mon[95499]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:57.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:57 smithi170 ceph-mon[99281]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:57.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:57 smithi170 ceph-mon[111392]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:59.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:59 smithi170 ceph-mon[99281]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:59.296 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:34:59 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:59.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:59 smithi170 ceph-mon[111392]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:59.296 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:34:59 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:34:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:59 smithi191 ceph-mon[95499]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:34:59.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:34:59 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:00.896 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.896 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.896 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.896 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[99281]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[111392]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:00.897 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:00 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:00.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:00 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:00 smithi191 ceph-mon[95499]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:00.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:00 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:03.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:03 smithi191 ceph-mon[95499]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:03.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:03 smithi170 ceph-mon[99281]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:03.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:03 smithi170 ceph-mon[111392]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:05.295 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:05 smithi170 ceph-mon[99281]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:05.295 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:05 smithi170 ceph-mon[111392]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:05.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:05 smithi191 ceph-mon[95499]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:06.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:05 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:35:05] "GET /metrics HTTP/1.1" 200 38869 "" "Prometheus/2.43.0" 2024-09-20T23:35:07.467 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:07 smithi170 ceph-mon[99281]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:07.467 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:07 smithi170 ceph-mon[111392]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:07.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:07 smithi191 ceph-mon[95499]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:09.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:09 smithi191 ceph-mon[95499]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:09.492 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:09 smithi170 ceph-mon[99281]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:09.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:09 smithi170 ceph-mon[111392]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:09.895 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ps' 2024-09-20T23:35:11.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:11 smithi170 ceph-mon[99281]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:11.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:11 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:11.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:11 smithi170 ceph-mon[111392]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:11.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:11 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:11.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:11 smithi191 ceph-mon[95499]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:11.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:11 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:12.002 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T23:35:12.002 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi170 smithi170 running 12s ago 25m - - 2024-09-20T23:35:12.002 INFO:teuthology.orchestra.run.smithi170.stdout:agent.smithi191 smithi191 running 0s ago 25m - - 2024-09-20T23:35:12.002 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.a smithi170 *:9093,9094 running (15m) 12s ago 20m - - 0.25.0 c8568f914cd2 9e5ce3d709a3 2024-09-20T23:35:12.002 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.a smithi191 *:3000 running (14m) 0s ago 20m 52.0M - dad864ee21e9 db20e8680365 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:iscsi.foo.smithi170.ykmvuq smithi170 running (74s) 12s ago 18m - - 3.8 cc9251b744a3 54a9687920b8 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi191 *:8443,9283,8765 running (14m) 0s ago 25m 536M - 19.1.1-367-g9e2ac70b cc9251b744a3 a86e5cf6e5e9 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi170 *:8443,9283,8765 running (12m) 12s ago 26m - - 19.1.1-367-g9e2ac70b cc9251b744a3 9116cb690f48 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (11m) 12s ago 26m - 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 9d2cac25e6ab 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi191 running (10m) 0s ago 25m 61.4M 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 7bf5a7dad99a 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi170 running (11m) 12s ago 25m - 2048M 19.1.1-367-g9e2ac70b cc9251b744a3 bca3ec9b13e4 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.a smithi170 *:9100 running (15m) 12s ago 21m - - 1.5.0 0da6a335fe13 086179c613bc 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.b smithi191 *:9100 running (14m) 0s ago 21m 15.1M - 1.5.0 0da6a335fe13 4c2e538de9fb 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 12s ago 24m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 90584937ee58 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 12s ago 24m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 e5cefa0c2434 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 12s ago 24m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1c1b5b411b5a 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (6m) 12s ago 23m - 2480M 19.1.1-367-g9e2ac70b cc9251b744a3 1a7afbc6a017 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi191 running (5m) 0s ago 23m 59.2M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 22f5bda84898 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (4m) 0s ago 22m 61.0M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 5f05fb895337 2024-09-20T23:35:12.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi191 running (3m) 0s ago 22m 58.1M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 9007c178854a 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi191 running (2m) 0s ago 21m 59.0M 2736M 19.1.1-367-g9e2ac70b cc9251b744a3 e1a3a02f75ee 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.a smithi191 *:9095 running (13m) 0s ago 21m 69.5M - 2.43.0 a07b618ecd1d 39d32c25d2c9 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi170.dfynrq smithi170 *:8000 running (2m) 12s ago 19m - - 19.1.1-367-g9e2ac70b cc9251b744a3 5f74ecbe7665 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.foo.smithi191.hyqqaq smithi191 *:8000 running (2m) 0s ago 19m 79.1M - 19.1.1-367-g9e2ac70b cc9251b744a3 1da78d577d0e 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi170.ojglvq smithi170 *:80 running (2m) 12s ago 19m - - 19.1.1-367-g9e2ac70b cc9251b744a3 b872b6a2fdae 2024-09-20T23:35:12.004 INFO:teuthology.orchestra.run.smithi170.stdout:rgw.smpl.smithi191.blxmkg smithi191 *:80 running (115s) 0s ago 19m 77.0M - 19.1.1-367-g9e2ac70b cc9251b744a3 02a9431eca43 2024-09-20T23:35:12.772 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions' 2024-09-20T23:35:12.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:12 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:12 smithi191 ceph-mon[95499]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:12.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:12 smithi191 ceph-mon[95499]: from='client.75043 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:12.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[99281]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:12.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[99281]: from='client.75043 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[111392]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:12.994 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:12 smithi170 ceph-mon[111392]: from='client.75043 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:13.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:13 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:13.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:13 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:13.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:13 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:14.743 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:14 smithi170 ceph-mon[99281]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:14.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:14 smithi170 ceph-mon[111392]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:14.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:14 smithi191 ceph-mon[95499]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:15.030 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 3 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 2 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 8 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw": { 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 4 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-20T23:35:15.031 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-20T23:35:15.032 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)": 17 2024-09-20T23:35:15.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-20T23:35:15.032 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:35:15.753 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch upgrade status' 2024-09-20T23:35:15.910 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:15 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/1727655959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:15.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:15 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/1727655959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:15.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:15 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/1727655959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:16.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:35:15] "GET /metrics HTTP/1.1" 200 38868 "" "Prometheus/2.43.0" 2024-09-20T23:35:16.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:16 smithi191 ceph-mon[95499]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:16.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:16 smithi170 ceph-mon[99281]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:16.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:16 smithi170 ceph-mon[111392]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "rgw", 2024-09-20T23:35:17.880 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: "iscsi", 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "18/23 daemons upgraded", 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed.", 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": true 2024-09-20T23:35:17.881 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:35:18.579 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph health detail' 2024-09-20T23:35:19.197 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:19 smithi170 ceph-mon[99281]: from='client.75055 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:19.198 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:19 smithi170 ceph-mon[99281]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:19.198 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:19 smithi170 ceph-mon[111392]: from='client.75055 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:19.198 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:19 smithi170 ceph-mon[111392]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:19 smithi191 ceph-mon[95499]: from='client.75055 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:19.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:19 smithi191 ceph-mon[95499]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[99281]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.054 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[111392]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:21.055 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:20 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:21.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:20 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:20 smithi191 ceph-mon[95499]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:21.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:20 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:21.729 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:35:21.729 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi170.ykmvuq on host smithi170 failed. 2024-09-20T23:35:21.729 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrade daemon: iscsi.foo.smithi170.ykmvuq: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi170.ykmvuq ... 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Creating ceph-iscsi config... 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/iscsi-gateway.cfg 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Write file: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/iscsi.foo.smithi170.ykmvuq/tcmu-runner-entrypoint.sh 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2d243152d6\x2d77a5\x2d11ef\x2dbaf5\x2defdc52797490.slice/ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl start ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout:Traceback (most recent call last): 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: return _run_code(code, main_globals, None, 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: exec(code, run_globals) 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5579, in 2024-09-20T23:35:21.730 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 5567, in main 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1088, in deploy_daemon 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/__main__.py", line 1224, in deploy_daemon_units 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout: File "/tmp/tmp3ebdx_ug.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout:RuntimeError: Failed command: systemctl start ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq: Job for ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service failed because the control process exited with error code. 2024-09-20T23:35:21.731 INFO:teuthology.orchestra.run.smithi170.stdout:See "systemctl status ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" and "journalctl -xeu ceph-243152d6-77a5-11ef-baf5-efdc52797490@iscsi.foo.smithi170.ykmvuq.service" for details. 2024-09-20T23:35:21.993 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:21 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/949737551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:35:21.993 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:21 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/949737551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:35:22.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:21 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/949737551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T23:35:22.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-20T23:35:23.065 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:22 smithi170 ceph-mon[99281]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:23.065 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:22 smithi170 ceph-mon[111392]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:23.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:22 smithi191 ceph-mon[95499]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:25.072 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-20T23:35:25.419 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:25 smithi170 ceph-mon[99281]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:25.420 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:25 smithi170 ceph-mon[111392]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:25.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:25 smithi191 ceph-mon[95499]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:25.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-20T23:35:26.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:26 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/3076030461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:26.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:35:25] "GET /metrics HTTP/1.1" 200 38868 "" "Prometheus/2.43.0" 2024-09-20T23:35:26.281 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:26 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/3076030461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:26.281 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:26 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/3076030461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:27.308 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:27 smithi170 ceph-mon[111392]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:27.308 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:27 smithi170 ceph-mon[99281]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:27.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:27 smithi191 ceph-mon[95499]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)" 2024-09-20T23:35:28.225 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:28 smithi170 ceph-mon[99281]: from='client.? 172.21.15.170:0/877897884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:28.225 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:28 smithi170 ceph-mon[111392]: from='client.? 172.21.15.170:0/877897884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:28.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:28 smithi191 ceph-mon[95499]: from='client.? 172.21.15.170:0/877897884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T23:35:28.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -e sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-09-20T23:35:29.163 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:29 smithi170 ceph-mon[99281]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:29.163 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:29 smithi170 ceph-mon[99281]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:29.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:29 smithi170 ceph-mon[111392]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:29.163 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:29 smithi170 ceph-mon[111392]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:29 smithi191 ceph-mon[95499]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:29.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:29 smithi191 ceph-mon[95499]: from='mgr.35369 172.21.15.191:0/2145341623' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T23:35:30.624 INFO:teuthology.orchestra.run.smithi170.stdout:osd 8 18s ago - 2024-09-20T23:35:31.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:31 smithi170 ceph-mon[99281]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:31.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:31 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:31.223 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:31 smithi170 ceph-mon[111392]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:31.223 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:31 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:31.246 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T23:35:31.256 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:35:31.256 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch upgrade ls' 2024-09-20T23:35:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:31 smithi191 ceph-mon[95499]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:31.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:31 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[99281]: from='client.75079 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[111392]: from='client.75079 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:32 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:32 smithi191 ceph-mon[95499]: from='client.75079 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:32.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:32 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:33.375 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:33 smithi191 ceph-mon[95499]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:33.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:33 smithi170 ceph-mon[99281]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:33.493 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:33 smithi170 ceph-mon[111392]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-20T23:35:33.835 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-20T23:35:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "image": "quay.io/ceph/ceph", 2024-09-20T23:35:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "registry": "quay.io", 2024-09-20T23:35:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "bare_image": "ceph/ceph", 2024-09-20T23:35:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "versions": [ 2024-09-20T23:35:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "19.1.1", 2024-09-20T23:35:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "19.1.0" 2024-09-20T23:35:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-09-20T23:35:33.836 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-20T23:35:34.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0' 2024-09-20T23:35:35.208 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:35 smithi170 ceph-mon[99281]: from='client.55137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:35.208 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:35 smithi170 ceph-mon[99281]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:35.208 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:35 smithi170 ceph-mon[111392]: from='client.55137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:35.208 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:35 smithi170 ceph-mon[111392]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:35.381 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:35 smithi191 ceph-mon[95499]: from='client.55137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:35.382 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:35 smithi191 ceph-mon[95499]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:35.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:35:35] "GET /metrics HTTP/1.1" 200 38871 "" "Prometheus/2.43.0" 2024-09-20T23:35:36.894 INFO:teuthology.orchestra.run.smithi170.stdout: "16.2.0", 2024-09-20T23:35:37.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:37 smithi170 ceph-mon[99281]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:37.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:37 smithi170 ceph-mon[111392]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:37.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:37 smithi191 ceph-mon[95499]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:37.629 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 243152d6-77a5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-09-20T23:35:38.164 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:38 smithi170 ceph-mon[99281]: from='client.55143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:38.164 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:38 smithi170 ceph-mon[111392]: from='client.55143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:38.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:38 smithi191 ceph-mon[95499]: from='client.55143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:39.129 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:39 smithi170 ceph-mon[99281]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:39.129 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:39 smithi170 ceph-mon[111392]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:39.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:39 smithi191 ceph-mon[95499]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-20T23:35:39.929 INFO:teuthology.orchestra.run.smithi170.stdout: "v16.2.2", 2024-09-20T23:35:39.930 INFO:teuthology.orchestra.run.smithi170.stdout: "v16.2.2-20210505", 2024-09-20T23:35:40.558 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-20T23:35:40.569 INFO:tasks.cephadm:Teardown begin 2024-09-20T23:35:40.569 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:35:40.597 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:35:40.634 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-20T23:35:40.634 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T23:35:40.653 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T23:35:40.692 INFO:tasks.cephadm:Stopping all daemons... 2024-09-20T23:35:40.692 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-20T23:35:40.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a 2024-09-20T23:35:40.798 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 systemd[1]: Stopping Ceph mon.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:41.226 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: from='client.75097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:41.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:41.227 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:40 smithi191 ceph-mon[95499]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: from='client.75097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[99281]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: from='client.75097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:41.243 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: from='mgr.35369 ' entity='mgr.x' 2024-09-20T23:35:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 288 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:35:41.244 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:40 smithi170 ceph-mon[111392]: from='client.75022 -' entity='client.iscsi.foo.smithi170.ykmvuq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-20T23:35:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[99277]: 2024-09-20T23:35:42.353+0000 7fd7917d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:42.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:42 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a[99277]: 2024-09-20T23:35:42.353+0000 7fd7917d2640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-09-20T23:35:42.881 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:42 smithi170 podman[197185]: 2024-09-20 23:35:42.567761803 +0000 UTC m=+0.317621054 container died 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70) 2024-09-20T23:35:43.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:42 smithi170 podman[197185]: 2024-09-20 23:35:42.987476336 +0000 UTC m=+0.737335584 container cleanup 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T23:35:43.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:42 smithi170 bash[197185]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a 2024-09-20T23:35:43.493 INFO:journalctl@ceph.mon.a.smithi170.stdout:Sep 20 23:35:43 smithi170 podman[197217]: 2024-09-20 23:35:43.222041199 +0000 UTC m=+0.649202307 container remove 9d2cac25e6abcc44c5c4a7cc6d00ca4947a6423f2f0131d7b9b1b33151b043c1 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:35:44.065 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.a.service' 2024-09-20T23:35:44.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:44.133 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-20T23:35:44.133 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-20T23:35:44.134 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c 2024-09-20T23:35:44.439 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 systemd[1]: Stopping Ceph mon.c for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:44.726 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:44] ENGINE Bus STOPPING 2024-09-20T23:35:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[111388]: 2024-09-20T23:35:44.436+0000 7fc93dc81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c[111388]: 2024-09-20T23:35:44.436+0000 7fc93dc81640 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-09-20T23:35:44.743 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 podman[197357]: 2024-09-20 23:35:44.580400523 +0000 UTC m=+0.264319951 container died bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-20T23:35:45.197 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 podman[197357]: 2024-09-20 23:35:44.953682003 +0000 UTC m=+0.637601428 container cleanup bca3ec9b13e47282efc6de09fd12a8ec6eb4900b55e1beab2e9d4887a9a1c384 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:35:45.197 INFO:journalctl@ceph.mon.c.smithi170.stdout:Sep 20 23:35:44 smithi170 bash[197357]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-c 2024-09-20T23:35:45.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:44] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-20T23:35:45.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:44] ENGINE Bus STOPPED 2024-09-20T23:35:45.226 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:44] ENGINE Bus STARTING 2024-09-20T23:35:45.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:45] ENGINE Serving on http://:::9283 2024-09-20T23:35:45.227 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: [20/Sep/2024:23:35:45] ENGINE Bus STARTED 2024-09-20T23:35:45.334 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.c.service' 2024-09-20T23:35:45.368 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:45.368 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-20T23:35:45.368 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-20T23:35:45.369 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b 2024-09-20T23:35:45.678 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:45 smithi191 systemd[1]: Stopping Ceph mon.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:45.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: ::ffff:172.21.15.191 - - [20/Sep/2024:23:35:45] "GET /metrics HTTP/1.1" 200 38872 "" "Prometheus/2.43.0" 2024-09-20T23:35:45.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[95495]: 2024-09-20T23:35:45.676+0000 7f618404d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:45.976 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b[95495]: 2024-09-20T23:35:45.676+0000 7f618404d640 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-09-20T23:35:45.977 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:45 smithi191 podman[176154]: 2024-09-20 23:35:45.891358566 +0000 UTC m=+0.326792690 container died 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-20T23:35:46.476 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:46 smithi191 podman[176154]: 2024-09-20 23:35:46.402352872 +0000 UTC m=+0.837786996 container cleanup 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:35:46.477 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:46 smithi191 bash[176154]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b 2024-09-20T23:35:46.881 INFO:journalctl@ceph.mon.b.smithi191.stdout:Sep 20 23:35:46 smithi191 podman[176167]: 2024-09-20 23:35:46.629008033 +0000 UTC m=+0.731504355 container remove 7bf5a7dad99a64627bfb0244c3cbb22b7d2cbe28552df6548cf1a7c5e970fe0f (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-20T23:35:46.886 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mon.b.service' 2024-09-20T23:35:46.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:46.929 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-20T23:35:46.930 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-20T23:35:46.930 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y 2024-09-20T23:35:47.242 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:35:46 smithi170 systemd[1]: Stopping Ceph mgr.y for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:47.576 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:35:47 smithi170 podman[197477]: 2024-09-20 23:35:47.272040431 +0000 UTC m=+0.143448231 container died 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-20T23:35:47.901 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:35:47 smithi170 podman[197477]: 2024-09-20 23:35:47.66613451 +0000 UTC m=+0.537542310 container cleanup 9116cb690f480edc6284ef770998b855a9aa0690bf178a009d001c6e1f4503ef (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:35:47.901 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Sep 20 23:35:47 smithi170 bash[197477]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-y 2024-09-20T23:35:48.036 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-20T23:35:48.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:48.070 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-20T23:35:48.070 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-20T23:35:48.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x 2024-09-20T23:35:48.392 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 systemd[1]: Stopping Ceph mgr.x for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:48.717 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:35:48.389+0000 7f187cf11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:48.717 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x[58987]: 2024-09-20T23:35:48.389+0000 7f187cf11640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-20T23:35:48.717 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 podman[176276]: 2024-09-20 23:35:48.431258148 +0000 UTC m=+0.162606360 container died a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-20T23:35:48.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 podman[176276]: 2024-09-20 23:35:48.831937716 +0000 UTC m=+0.563285926 container cleanup a86e5cf6e5e9f1c7b93bf21d9b7d10216a16818d6475cd14b784a96b1512745d (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-20T23:35:48.976 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Sep 20 23:35:48 smithi191 bash[176276]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-mgr-x 2024-09-20T23:35:49.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-20T23:35:49.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:49.300 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-20T23:35:49.300 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-20T23:35:49.300 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0 2024-09-20T23:35:49.597 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:49 smithi170 systemd[1]: Stopping Ceph osd.0 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:49.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:35:49.595+0000 7f0ab1ab0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:49.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:35:49.595+0000 7f0ab1ab0640 -1 osd.0 185 *** Got signal Terminated *** 2024-09-20T23:35:49.993 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:49 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0[123177]: 2024-09-20T23:35:49.595+0000 7f0ab1ab0640 -1 osd.0 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:35:55.206 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:54 smithi170 podman[197600]: 2024-09-20 23:35:54.942451124 +0000 UTC m=+5.446484479 container died 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:35:55.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:55 smithi170 podman[197600]: 2024-09-20 23:35:55.378719366 +0000 UTC m=+5.882752762 container cleanup 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70) 2024-09-20T23:35:55.493 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:55 smithi170 bash[197600]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0 2024-09-20T23:35:55.990 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:55 smithi170 podman[197617]: 2024-09-20 23:35:55.580108967 +0000 UTC m=+0.635126345 container remove 90584937ee589e514c6db8cd7f0d3613ba03fe562eb6f74dce5a8d67b2e6bff9 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:35:56.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:55 smithi170 podman[197706]: 2024-09-20 23:35:55.989224822 +0000 UTC m=+0.109618534 container create d49ed481b3cc918098dad69e6e8b6c64144509fb76743840a7efd02f3ab29ae4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-20T23:35:56.243 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:55 smithi170 podman[197706]: 2024-09-20 23:35:55.895624479 +0000 UTC m=+0.016018148 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:35:56.721 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:56 smithi170 podman[197706]: 2024-09-20 23:35:56.24178793 +0000 UTC m=+0.362181586 container init d49ed481b3cc918098dad69e6e8b6c64144509fb76743840a7efd02f3ab29ae4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-20T23:35:56.721 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:56 smithi170 podman[197706]: 2024-09-20 23:35:56.245904263 +0000 UTC m=+0.366297921 container start d49ed481b3cc918098dad69e6e8b6c64144509fb76743840a7efd02f3ab29ae4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=squid-9e2ac70, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:35:56.722 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:56 smithi170 podman[197706]: 2024-09-20 23:35:56.333494675 +0000 UTC m=+0.453888326 container attach d49ed481b3cc918098dad69e6e8b6c64144509fb76743840a7efd02f3ab29ae4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T23:35:56.722 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 20 23:35:56 smithi170 podman[197706]: 2024-09-20 23:35:56.439856006 +0000 UTC m=+0.560249665 container died d49ed481b3cc918098dad69e6e8b6c64144509fb76743840a7efd02f3ab29ae4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:35:57.099 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.0.service' 2024-09-20T23:35:57.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:35:57.141 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-20T23:35:57.141 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-20T23:35:57.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1 2024-09-20T23:35:57.475 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:35:57 smithi170 systemd[1]: Stopping Ceph osd.1 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:35:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:35:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:35:57.472+0000 7f8cc9397640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:35:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:35:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:35:57.472+0000 7f8cc9397640 -1 osd.1 185 *** Got signal Terminated *** 2024-09-20T23:35:57.743 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:35:57 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1[135463]: 2024-09-20T23:35:57.472+0000 7f8cc9397640 -1 osd.1 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:03.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:03 smithi170 podman[197921]: 2024-09-20 23:36:03.167450466 +0000 UTC m=+5.788932539 container died e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T23:36:03.951 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:03 smithi170 podman[197921]: 2024-09-20 23:36:03.61412822 +0000 UTC m=+6.235610277 container cleanup e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-20T23:36:03.952 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:03 smithi170 bash[197921]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1 2024-09-20T23:36:04.907 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:04 smithi170 podman[198542]: 2024-09-20 23:36:04.502141609 +0000 UTC m=+1.559890842 container remove e5cefa0c2434ea428e4a58b167b7cc8ebde04e016fc6315007231653bf8c7472 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T23:36:05.160 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:04 smithi170 podman[198685]: 2024-09-20 23:36:04.809143483 +0000 UTC m=+0.016057683 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:05.160 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:04 smithi170 podman[198685]: 2024-09-20 23:36:04.919629418 +0000 UTC m=+0.126543608 container create d3a1d67f2e38dcdef9d788106b72fba6b7258bee90149d1f5344b9731bc71ace (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-20T23:36:05.160 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:05 smithi170 podman[198685]: 2024-09-20 23:36:05.155764769 +0000 UTC m=+0.362678965 container init d3a1d67f2e38dcdef9d788106b72fba6b7258bee90149d1f5344b9731bc71ace (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:36:05.160 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:05 smithi170 podman[198685]: 2024-09-20 23:36:05.158969081 +0000 UTC m=+0.365883272 container start d3a1d67f2e38dcdef9d788106b72fba6b7258bee90149d1f5344b9731bc71ace (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-20T23:36:05.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:05 smithi170 podman[198685]: 2024-09-20 23:36:05.26426792 +0000 UTC m=+0.471182130 container attach d3a1d67f2e38dcdef9d788106b72fba6b7258bee90149d1f5344b9731bc71ace (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=squid-9e2ac70, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-20T23:36:05.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 20 23:36:05 smithi170 podman[198685]: 2024-09-20 23:36:05.351926658 +0000 UTC m=+0.558840861 container died d3a1d67f2e38dcdef9d788106b72fba6b7258bee90149d1f5344b9731bc71ace (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-20T23:36:05.949 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.1.service' 2024-09-20T23:36:05.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:05.990 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-20T23:36:05.990 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-20T23:36:05.991 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2 2024-09-20T23:36:06.242 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:06 smithi170 systemd[1]: Stopping Ceph osd.2 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:06.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:36:06.345+0000 7fc2a9855640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:06.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:36:06.345+0000 7fc2a9855640 -1 osd.2 185 *** Got signal Terminated *** 2024-09-20T23:36:06.743 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:06 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2[147528]: 2024-09-20T23:36:06.345+0000 7fc2a9855640 -1 osd.2 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:11.956 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:11 smithi170 podman[198798]: 2024-09-20 23:36:11.692179781 +0000 UTC m=+5.467627265 container died 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T23:36:12.214 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198798]: 2024-09-20 23:36:12.037064069 +0000 UTC m=+5.812511553 container cleanup 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-20T23:36:12.214 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 bash[198798]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2 2024-09-20T23:36:12.492 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198813]: 2024-09-20 23:36:12.213091987 +0000 UTC m=+0.515132105 container remove 1c1b5b411b5a4397265b6b0da1d0cb928c8510ab3b025ca7439ee5a126996c0c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-20T23:36:12.909 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198903]: 2024-09-20 23:36:12.535015486 +0000 UTC m=+0.016017796 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:12.909 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198903]: 2024-09-20 23:36:12.647330351 +0000 UTC m=+0.128332634 container create 2f8e0f8748d127afc4beed237790ad965de7bd1b52c62cd2fe37f68451021d06 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-20T23:36:12.909 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198903]: 2024-09-20 23:36:12.908467904 +0000 UTC m=+0.389470191 container init 2f8e0f8748d127afc4beed237790ad965de7bd1b52c62cd2fe37f68451021d06 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:36:13.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:12 smithi170 podman[198903]: 2024-09-20 23:36:12.911999731 +0000 UTC m=+0.393002018 container start 2f8e0f8748d127afc4beed237790ad965de7bd1b52c62cd2fe37f68451021d06 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=) 2024-09-20T23:36:13.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:13 smithi170 podman[198903]: 2024-09-20 23:36:13.008371598 +0000 UTC m=+0.489373893 container attach 2f8e0f8748d127afc4beed237790ad965de7bd1b52c62cd2fe37f68451021d06 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-20T23:36:13.243 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 20 23:36:13 smithi170 podman[198903]: 2024-09-20 23:36:13.098442144 +0000 UTC m=+0.579444436 container died 2f8e0f8748d127afc4beed237790ad965de7bd1b52c62cd2fe37f68451021d06 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, ceph=True) 2024-09-20T23:36:13.750 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.2.service' 2024-09-20T23:36:13.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:13.792 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-20T23:36:13.792 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-20T23:36:13.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.3 2024-09-20T23:36:13.993 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:13 smithi170 systemd[1]: Stopping Ceph osd.3 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:14.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:36:14.114+0000 7f3cae722640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:14.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:36:14.114+0000 7f3cae722640 -1 osd.3 185 *** Got signal Terminated *** 2024-09-20T23:36:14.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:14 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:36:14.114+0000 7f3cae722640 -1 osd.3 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:16.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:15 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:15.888+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:17.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:16 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:16.872+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:17.992 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:17 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:36:17.660+0000 7f3ca6d30640 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.139117+0000 front 2024-09-20T23:35:52.139159+0000 (oldest deadline 2024-09-20T23:36:17.439241+0000) 2024-09-20T23:36:18.207 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:17 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:17.854+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:18.870 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:18.578+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:18.870 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:18.640Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.191:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.191:8765: connect: connection refused" 2024-09-20T23:36:18.870 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:18.642Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.191:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.191:8765: connect: connection refused" 2024-09-20T23:36:18.870 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:18.642Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.191:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.191:8765: connect: connection refused" 2024-09-20T23:36:18.871 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:18.643Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.191:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.191:8765: connect: connection refused" 2024-09-20T23:36:18.871 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:18.643Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.191:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.191:8765: connect: connection refused" 2024-09-20T23:36:18.993 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:18 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3[154043]: 2024-09-20T23:36:18.644+0000 7f3ca6d30640 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.139117+0000 front 2024-09-20T23:35:52.139159+0000 (oldest deadline 2024-09-20T23:36:17.439241+0000) 2024-09-20T23:36:19.213 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:18.977+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:19.213 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:18 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:18.868+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:19.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:19 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:19.211+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:19.859 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:19 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:19.529+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:19.867 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:19 smithi170 podman[199006]: 2024-09-20 23:36:19.594406673 +0000 UTC m=+5.583019521 container died 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-20T23:36:20.194 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:19 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:19.857+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:20.194 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:20.020+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:20.242 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199006]: 2024-09-20 23:36:20.073255455 +0000 UTC m=+6.061868302 container cleanup 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70) 2024-09-20T23:36:20.243 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 bash[199006]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3 2024-09-20T23:36:20.466 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:20.192+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:20.685 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199022]: 2024-09-20 23:36:20.33297142 +0000 UTC m=+0.738123892 container remove 1a7afbc6a0179f9bf03e6a3c95326d67e3a0f534cfd453b04364e414b98b577e (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:36:20.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:20.537+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:20.953 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199114]: 2024-09-20 23:36:20.587551302 +0000 UTC m=+0.015738519 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:20.954 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199114]: 2024-09-20 23:36:20.700324665 +0000 UTC m=+0.128511879 container create 141fdc6cb12301d57d20ac41432cec684537bcea2b58cef5ccdaef75474ad718 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:36:20.954 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199114]: 2024-09-20 23:36:20.952554219 +0000 UTC m=+0.380741435 container init 141fdc6cb12301d57d20ac41432cec684537bcea2b58cef5ccdaef75474ad718 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T23:36:21.187 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:21 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:21.022+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:21.187 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:20 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:20.905+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:21.243 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:20 smithi170 podman[199114]: 2024-09-20 23:36:20.955816109 +0000 UTC m=+0.384003328 container start 141fdc6cb12301d57d20ac41432cec684537bcea2b58cef5ccdaef75474ad718 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-9e2ac70) 2024-09-20T23:36:21.243 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:21 smithi170 podman[199114]: 2024-09-20 23:36:21.044304364 +0000 UTC m=+0.472491594 container attach 141fdc6cb12301d57d20ac41432cec684537bcea2b58cef5ccdaef75474ad718 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:36:21.243 INFO:journalctl@ceph.osd.3.smithi170.stdout:Sep 20 23:36:21 smithi170 podman[199114]: 2024-09-20 23:36:21.145847881 +0000 UTC m=+0.574035091 container died 141fdc6cb12301d57d20ac41432cec684537bcea2b58cef5ccdaef75474ad718 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731) 2024-09-20T23:36:21.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:21 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:21.185+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:21.957 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:21 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:21.542+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:22.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:22.145+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:22.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:22.067+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:22.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:21 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:21.955+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:22.381 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.3.service' 2024-09-20T23:36:22.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:22.427 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-20T23:36:22.427 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-20T23:36:22.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4 2024-09-20T23:36:22.726 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:22 smithi191 systemd[1]: Stopping Ceph osd.4 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:22.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:22.578+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:23.043 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:22.927+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:23.043 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:22.725+0000 7f89deaf8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:23.043 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:22.725+0000 7f89deaf8640 -1 osd.4 185 *** Got signal Terminated *** 2024-09-20T23:36:23.044 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:22 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:22.725+0000 7f89deaf8640 -1 osd.4 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:23.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:23.134+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:23.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:23.041+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:23.939 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:23.608+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:24.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:23.997+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:24.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:24.128+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:24.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:23 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:23.938+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:24.905 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:24.612+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:25.158 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:24 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:24.903+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:25.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:25.009+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:25.159 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:25.009+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:25.476 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:25.157+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:25.935 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:25.605+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:26.226 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:26.149+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:26.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:26.050+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:26.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:26.050+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:26.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:25.933+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:26.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:25 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:25.933+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:26.976 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:26.561+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:26.976 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:26.561+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:27.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:27.081+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:27.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:27.081+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:27.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:27.161+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:53.843141+0000 front 2024-09-20T23:35:53.843209+0000 (oldest deadline 2024-09-20T23:36:19.143278+0000) 2024-09-20T23:36:27.477 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4[127897]: 2024-09-20T23:36:27.161+0000 7f89d7106640 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.245208+0000 front 2024-09-20T23:36:01.245116+0000 (oldest deadline 2024-09-20T23:36:27.145133+0000) 2024-09-20T23:36:27.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:26.979+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:27.477 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:26 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:26.979+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:27.937 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:27.512+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:27.937 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:27.512+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:28.227 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:28 smithi191 podman[177358]: 2024-09-20 23:36:28.122923927 +0000 UTC m=+5.495187510 container died 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-9e2ac70) 2024-09-20T23:36:28.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:28.042+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:28.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:28.042+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:28.228 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:27.935+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:28.228 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:27 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:27.935+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:28.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:28.521+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:28.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:28.521+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:28.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:28 smithi191 podman[177358]: 2024-09-20 23:36:28.617032495 +0000 UTC m=+5.989296119 container cleanup 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-20T23:36:28.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:28 smithi191 bash[177358]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4 2024-09-20T23:36:29.180 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:28 smithi191 podman[177374]: 2024-09-20 23:36:28.851731064 +0000 UTC m=+0.726007256 container remove 22f5bda84898fc14ea7dc12a21b9c02aa43a665e9f72cd85c8fc6333ea24a654 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:29.181 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:29.007+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:29.181 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:29.007+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:29.181 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:28.898+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:29.181 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:28 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:28.898+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:29.440 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.082289054 +0000 UTC m=+0.015828599 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:29.440 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.185788496 +0000 UTC m=+0.119328050 container create b3efd6b05ce7c13f6081f41bb8b0d0f0763b13e54d70d936ba2bdc5d9b3fac7a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T23:36:29.440 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.439164252 +0000 UTC m=+0.372703801 container init b3efd6b05ce7c13f6081f41bb8b0d0f0763b13e54d70d936ba2bdc5d9b3fac7a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70) 2024-09-20T23:36:29.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.442818054 +0000 UTC m=+0.376357604 container start b3efd6b05ce7c13f6081f41bb8b0d0f0763b13e54d70d936ba2bdc5d9b3fac7a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:29.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.52187821 +0000 UTC m=+0.455417774 container attach b3efd6b05ce7c13f6081f41bb8b0d0f0763b13e54d70d936ba2bdc5d9b3fac7a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:29.727 INFO:journalctl@ceph.osd.4.smithi191.stdout:Sep 20 23:36:29 smithi191 podman[177463]: 2024-09-20 23:36:29.633361297 +0000 UTC m=+0.566900843 container died b3efd6b05ce7c13f6081f41bb8b0d0f0763b13e54d70d936ba2bdc5d9b3fac7a (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-20T23:36:29.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:29.544+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:29.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:29.544+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:30.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:29.961+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:30.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:29.961+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:30.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:29.936+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:30.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:29 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:29.936+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:30.459 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.4.service' 2024-09-20T23:36:30.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:30.504 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-20T23:36:30.504 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-20T23:36:30.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5 2024-09-20T23:36:30.726 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 systemd[1]: Stopping Ceph osd.5 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:30.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:30.496+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:30.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:30.496+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:31.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:30.959+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:31.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:30.959+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:31.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:30.828+0000 7f36d2e31640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:30.828+0000 7f36d2e31640 -1 osd.5 185 *** Got signal Terminated *** 2024-09-20T23:36:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:30.828+0000 7f36d2e31640 -1 osd.5 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:30.919+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:31.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:30 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:30.919+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:31.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:31.453+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:31.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:31.453+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:32.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:31.883+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:32.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:31.883+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:32.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:31.982+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:32.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:31 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:31.982+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:32.695 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:32.426+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:32.695 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:32.426+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:32.974 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:32.855+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:32.974 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:32.855+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:33.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:32.973+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:33.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:32.973+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:33.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:32 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:32.973+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:33.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:33.447+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:33.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:33.447+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:34.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:33.945+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:34.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:33.945+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:34.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:33.945+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:34.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:33.869+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:34.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:33.869+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:34.227 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:33 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:33.869+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.337164+0000 front 2024-09-20T23:36:10.337150+0000 (oldest deadline 2024-09-20T23:36:33.836934+0000) 2024-09-20T23:36:34.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:34.431+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:34.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:34.431+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:35.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:34.851+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:52.834728+0000 front 2024-09-20T23:35:52.834640+0000 (oldest deadline 2024-09-20T23:36:18.134638+0000) 2024-09-20T23:36:35.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:34.851+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:35:58.135167+0000 front 2024-09-20T23:35:58.135243+0000 (oldest deadline 2024-09-20T23:36:24.035107+0000) 2024-09-20T23:36:35.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5[138645]: 2024-09-20T23:36:34.851+0000 7f36cb43f640 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.337164+0000 front 2024-09-20T23:36:10.337150+0000 (oldest deadline 2024-09-20T23:36:33.836934+0000) 2024-09-20T23:36:35.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:34.941+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:35.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:34.941+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:35.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:34 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:34.941+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:35.667 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:35.427+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:35.667 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:35.427+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:35.668 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:35.427+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:36.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:35.953+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:36.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:35.953+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:36.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:35 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:35.953+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:36.658 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:36 smithi191 podman[177567]: 2024-09-20 23:36:36.371815704 +0000 UTC m=+5.634840271 container died 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T23:36:36.658 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:36.413+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:36.658 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:36.413+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:36.658 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:36.413+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:36.912 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:36 smithi191 podman[177567]: 2024-09-20 23:36:36.773182243 +0000 UTC m=+6.036206844 container cleanup 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, ceph=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-20T23:36:36.912 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:36 smithi191 bash[177567]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5 2024-09-20T23:36:37.226 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:37 smithi191 podman[178252]: 2024-09-20 23:36:37.024281585 +0000 UTC m=+0.829823510 container remove 5f05fb895337c4972655919dc8c23c8b8f22eee7de85f31747cc31a63679d6ba (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-9e2ac70, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-20T23:36:37.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:36.910+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:37.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:36.910+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:37.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:36 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:36.910+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:37.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:37.373+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:37.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:37.373+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:37.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:37.373+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:38.132 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:37.909+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:38.132 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:37.909+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:38.133 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:37 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:37.909+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:38.133 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:37 smithi191 podman[178378]: 2024-09-20 23:36:37.743455042 +0000 UTC m=+0.016080519 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:38.133 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:37 smithi191 podman[178378]: 2024-09-20 23:36:37.8448046 +0000 UTC m=+0.117430063 container create 2e2b79af2cf793c50c8ee06e040ff581af3c84a36f3e3980e38a75bec68d4461 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-20T23:36:38.133 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:38 smithi191 podman[178378]: 2024-09-20 23:36:38.080846663 +0000 UTC m=+0.353472137 container init 2e2b79af2cf793c50c8ee06e040ff581af3c84a36f3e3980e38a75bec68d4461 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-20T23:36:38.133 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:38 smithi191 podman[178378]: 2024-09-20 23:36:38.084347801 +0000 UTC m=+0.356973271 container start 2e2b79af2cf793c50c8ee06e040ff581af3c84a36f3e3980e38a75bec68d4461 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:38.476 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:38 smithi191 podman[178378]: 2024-09-20 23:36:38.197823338 +0000 UTC m=+0.470448810 container attach 2e2b79af2cf793c50c8ee06e040ff581af3c84a36f3e3980e38a75bec68d4461 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-20T23:36:38.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:38.332+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:38.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:38.332+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:38.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:38.332+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:39.073 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 20 23:36:38 smithi191 podman[178378]: 2024-09-20 23:36:38.813346417 +0000 UTC m=+1.085971888 container died 2e2b79af2cf793c50c8ee06e040ff581af3c84a36f3e3980e38a75bec68d4461 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T23:36:39.073 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:38.884+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:39.073 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:38.884+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:39.073 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:38 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:38.884+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:39.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:39.320+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:39.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:39.320+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:39.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:39.320+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:39.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.5.service' 2024-09-20T23:36:39.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:39.668 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-20T23:36:39.668 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-20T23:36:39.668 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6 2024-09-20T23:36:39.890 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:39 smithi191 systemd[1]: Stopping Ceph osd.6 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.888+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.888+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:39 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.888+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.999+0000 7fc5e5fa4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.999+0000 7fc5e5fa4640 -1 osd.6 185 *** Got signal Terminated *** 2024-09-20T23:36:40.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:39.999+0000 7fc5e5fa4640 -1 osd.6 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:40.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:40.355+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:40.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:40.355+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:40.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:40.355+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:41.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:40.883+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:41.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:40.883+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:41.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:40.883+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:41.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:40.883+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:16.021962+0000 front 2024-09-20T23:36:16.021925+0000 (oldest deadline 2024-09-20T23:36:40.022148+0000) 2024-09-20T23:36:41.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:41.398+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:41.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:41.398+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:41.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:41.398+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:41.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:41.398+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:42.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:41.861+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:42.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:41.861+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:42.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:41.861+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:42.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:41 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:41.861+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:16.021962+0000 front 2024-09-20T23:36:16.021925+0000 (oldest deadline 2024-09-20T23:36:40.022148+0000) 2024-09-20T23:36:42.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:42.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:42.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:42.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:42.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:42.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:42.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:42.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:43.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:42.865+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:43.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:42.865+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:43.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:42.865+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:43.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:42 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:42.865+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:16.021962+0000 front 2024-09-20T23:36:16.021925+0000 (oldest deadline 2024-09-20T23:36:40.022148+0000) 2024-09-20T23:36:43.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:43.374+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:43.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:43.374+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:43.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:43.374+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:43.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:43.374+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:44.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:43.816+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:44.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:43.816+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:44.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:43.816+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:44.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:43 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:43.816+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:16.021962+0000 front 2024-09-20T23:36:16.021925+0000 (oldest deadline 2024-09-20T23:36:40.022148+0000) 2024-09-20T23:36:44.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:44.369+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:44.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:44.369+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:44.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:44.369+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:44.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:44.369+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:45.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:44.857+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:51.618576+0000 front 2024-09-20T23:35:51.618424+0000 (oldest deadline 2024-09-20T23:36:15.718406+0000) 2024-09-20T23:36:45.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:44.857+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:02.119902+0000 front 2024-09-20T23:36:02.119960+0000 (oldest deadline 2024-09-20T23:36:25.019810+0000) 2024-09-20T23:36:45.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:44.857+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:07.320810+0000 front 2024-09-20T23:36:07.320772+0000 (oldest deadline 2024-09-20T23:36:32.020618+0000) 2024-09-20T23:36:45.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:44 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6[150530]: 2024-09-20T23:36:44.857+0000 7fc5de5b2640 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:16.021962+0000 front 2024-09-20T23:36:16.021925+0000 (oldest deadline 2024-09-20T23:36:40.022148+0000) 2024-09-20T23:36:45.727 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:45 smithi191 podman[178518]: 2024-09-20 23:36:45.460616985 +0000 UTC m=+5.562585094 container died 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-20T23:36:45.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:45.371+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:45.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:45.371+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:45.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:45.371+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:45.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:45 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:45.371+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:46.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:45 smithi191 podman[178518]: 2024-09-20 23:36:45.908184728 +0000 UTC m=+6.010152836 container cleanup 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:46.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:45 smithi191 bash[178518]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6 2024-09-20T23:36:46.677 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:46 smithi191 podman[178533]: 2024-09-20 23:36:46.27658571 +0000 UTC m=+0.813013978 container remove 9007c178854a4d19f576a6540ad4670162ef2e6d057e332e8d317a00d88ef08c (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-9e2ac70, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-20T23:36:46.677 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:46.363+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:46.677 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:46.363+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:46.677 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:46.363+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:46.678 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:46 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:46.363+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:46.972 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:46 smithi191 podman[178620]: 2024-09-20 23:36:46.579054703 +0000 UTC m=+0.015935585 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:46.972 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:46 smithi191 podman[178620]: 2024-09-20 23:36:46.677078674 +0000 UTC m=+0.113959549 container create 5d33f550e8c90ccfff33cecfa5c5f694476e4d7a8a648c5523c69fbe15c6bb50 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-20T23:36:47.226 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:46 smithi191 podman[178620]: 2024-09-20 23:36:46.971720237 +0000 UTC m=+0.408601117 container init 5d33f550e8c90ccfff33cecfa5c5f694476e4d7a8a648c5523c69fbe15c6bb50 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=squid-9e2ac70, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T23:36:47.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:46 smithi191 podman[178620]: 2024-09-20 23:36:46.9750429 +0000 UTC m=+0.411923775 container start 5d33f550e8c90ccfff33cecfa5c5f694476e4d7a8a648c5523c69fbe15c6bb50 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:36:47.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:47 smithi191 podman[178620]: 2024-09-20 23:36:47.071659258 +0000 UTC m=+0.508540141 container attach 5d33f550e8c90ccfff33cecfa5c5f694476e4d7a8a648c5523c69fbe15c6bb50 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-9e2ac70, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-20T23:36:47.227 INFO:journalctl@ceph.osd.6.smithi191.stdout:Sep 20 23:36:47 smithi191 podman[178620]: 2024-09-20 23:36:47.169181871 +0000 UTC m=+0.606062752 container died 5d33f550e8c90ccfff33cecfa5c5f694476e4d7a8a648c5523c69fbe15c6bb50 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, CEPH_POINT_RELEASE=) 2024-09-20T23:36:47.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:47.336+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:47.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:47.336+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:47.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:47.336+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:47.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:47 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:47.336+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:47.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.6.service' 2024-09-20T23:36:47.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:47.880 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-20T23:36:47.880 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-20T23:36:47.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.7 2024-09-20T23:36:48.196 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:47 smithi191 systemd[1]: Stopping Ceph osd.7 for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:48.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.194+0000 7ff865bd2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T23:36:48.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.194+0000 7ff865bd2640 -1 osd.7 185 *** Got signal Terminated *** 2024-09-20T23:36:48.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.194+0000 7ff865bd2640 -1 osd.7 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T23:36:48.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.368+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:48.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.368+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:48.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.368+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:48.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:48 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:48.368+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:49.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:49.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:49.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:49.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:49.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:49.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:49.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:49.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:49.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:49 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:49.416+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.191:6804 osd.4 since back 2024-09-20T23:36:25.112564+0000 front 2024-09-20T23:36:25.112456+0000 (oldest deadline 2024-09-20T23:36:49.212438+0000) 2024-09-20T23:36:50.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:50.393+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:50.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:50.393+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:50.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:50.393+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:50.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:50.393+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:50.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:50 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:50.393+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.191:6804 osd.4 since back 2024-09-20T23:36:25.112564+0000 front 2024-09-20T23:36:25.112456+0000 (oldest deadline 2024-09-20T23:36:49.212438+0000) 2024-09-20T23:36:51.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:51 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:51.375+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:51.476 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:51 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:51.375+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:51.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:51 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:51.375+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:51.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:51 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:51.375+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:51.477 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:51 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:51.375+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.191:6804 osd.4 since back 2024-09-20T23:36:25.112564+0000 front 2024-09-20T23:36:25.112456+0000 (oldest deadline 2024-09-20T23:36:49.212438+0000) 2024-09-20T23:36:52.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:52.370+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6804 osd.0 since back 2024-09-20T23:35:54.308358+0000 front 2024-09-20T23:35:54.308347+0000 (oldest deadline 2024-09-20T23:36:18.408358+0000) 2024-09-20T23:36:52.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:52.370+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6812 osd.1 since back 2024-09-20T23:36:01.809744+0000 front 2024-09-20T23:36:01.809883+0000 (oldest deadline 2024-09-20T23:36:25.909580+0000) 2024-09-20T23:36:52.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:52.370+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6820 osd.2 since back 2024-09-20T23:36:10.610504+0000 front 2024-09-20T23:36:10.610517+0000 (oldest deadline 2024-09-20T23:36:34.710328+0000) 2024-09-20T23:36:52.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:52.370+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.170:6828 osd.3 since back 2024-09-20T23:36:15.811346+0000 front 2024-09-20T23:36:15.811313+0000 (oldest deadline 2024-09-20T23:36:41.111206+0000) 2024-09-20T23:36:52.727 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:52 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7[155929]: 2024-09-20T23:36:52.370+0000 7ff85e1e0640 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.191:6804 osd.4 since back 2024-09-20T23:36:25.112564+0000 front 2024-09-20T23:36:25.112456+0000 (oldest deadline 2024-09-20T23:36:49.212438+0000) 2024-09-20T23:36:54.021 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:53 smithi191 podman[178721]: 2024-09-20 23:36:53.74436289 +0000 UTC m=+5.645682969 container died e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T23:36:54.472 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:54 smithi191 podman[178721]: 2024-09-20 23:36:54.211359226 +0000 UTC m=+6.112679340 container cleanup e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, ceph=True, RELEASE=squid-9e2ac70, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-20T23:36:54.472 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:54 smithi191 bash[178721]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7 2024-09-20T23:36:54.726 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:54 smithi191 podman[178887]: 2024-09-20 23:36:54.470908169 +0000 UTC m=+0.721211227 container remove e1a3a02f75eee0b1fc26ad941a61c11ff796eeb82c243a7bad6d803cad8a07b4 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-20T23:36:55.150 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:54 smithi191 podman[179006]: 2024-09-20 23:36:54.744302324 +0000 UTC m=+0.016353864 image pull cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T23:36:55.150 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:54 smithi191 podman[179006]: 2024-09-20 23:36:54.854942779 +0000 UTC m=+0.126994310 container create bb1e93ec8db43a1c8b3af1c1e855721423b20d557975ad354a6d4b14049722d0 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:36:55.150 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:55 smithi191 podman[179006]: 2024-09-20 23:36:55.065708147 +0000 UTC m=+0.337759686 container init bb1e93ec8db43a1c8b3af1c1e855721423b20d557975ad354a6d4b14049722d0 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-9e2ac70, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T23:36:55.150 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:55 smithi191 podman[179006]: 2024-09-20 23:36:55.0693526 +0000 UTC m=+0.341404131 container start bb1e93ec8db43a1c8b3af1c1e855721423b20d557975ad354a6d4b14049722d0 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-9e2ac70, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T23:36:55.151 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:55 smithi191 podman[179006]: 2024-09-20 23:36:55.148878995 +0000 UTC m=+0.420930528 container attach bb1e93ec8db43a1c8b3af1c1e855721423b20d557975ad354a6d4b14049722d0 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-9e2ac70, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-20T23:36:55.429 INFO:journalctl@ceph.osd.7.smithi191.stdout:Sep 20 23:36:55 smithi191 podman[179006]: 2024-09-20 23:36:55.289375198 +0000 UTC m=+0.561426738 container died bb1e93ec8db43a1c8b3af1c1e855721423b20d557975ad354a6d4b14049722d0 (image=quay.ceph.io/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-9e2ac70, GIT_CLEAN=True) 2024-09-20T23:36:55.877 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@osd.7.service' 2024-09-20T23:36:55.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:55.915 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-20T23:36:55.915 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-20T23:36:55.915 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a 2024-09-20T23:36:56.226 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:55 smithi191 systemd[1]: Stopping Ceph prometheus.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-20T23:36:57.727 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-20T23:36:57.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-20T23:36:57.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-20T23:36:57.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.480Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-20T23:36:57.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a[61490]: ts=2024-09-20T23:36:57.481Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-20T23:36:57.728 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 podman[179233]: 2024-09-20 23:36:57.490963275 +0000 UTC m=+0.343945253 container died 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:36:58.123 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 podman[179233]: 2024-09-20 23:36:57.855532705 +0000 UTC m=+0.708514674 container cleanup 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:36:58.124 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:57 smithi191 bash[179233]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a 2024-09-20T23:36:58.434 INFO:journalctl@ceph.prometheus.a.smithi191.stdout:Sep 20 23:36:58 smithi191 podman[179252]: 2024-09-20 23:36:58.123000342 +0000 UTC m=+0.634471499 container remove 39d32c25d2c939ec023db1720b94971080a6a702109c49ac46d2148e5d20cbcd (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-20T23:36:58.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-243152d6-77a5-11ef-baf5-efdc52797490@prometheus.a.service' 2024-09-20T23:36:58.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T23:36:58.493 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-20T23:36:58.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 243152d6-77a5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T23:37:00.493 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:00 smithi170 systemd[1]: Stopping Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:37:00.493 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:00 smithi170 podman[200548]: 2024-09-20 23:37:00.431308284 +0000 UTC m=+0.106372141 container died 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:00.992 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:00 smithi170 podman[200548]: 2024-09-20 23:37:00.88760599 +0000 UTC m=+0.562669843 container cleanup 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:00.993 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:00 smithi170 bash[200548]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a 2024-09-20T23:37:01.491 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:01 smithi170 podman[200560]: 2024-09-20 23:37:01.172286552 +0000 UTC m=+0.742932615 container remove 086179c613bc736f0a0b9158edb367463642b3e0ef3f10a1d7e8414a9e5ea731 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:01.492 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:37:01.492 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-20T23:37:01.492 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:01 smithi170 systemd[1]: Stopped Ceph node-exporter.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:37:01.492 INFO:journalctl@ceph.node-exporter.a.smithi170.stdout:Sep 20 23:37:01 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.a.service: Consumed 3.436s CPU time. 2024-09-20T23:37:01.742 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:01 smithi170 systemd[1]: Stopping Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:37:02.069 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:01 smithi170 ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a[63290]: ts=2024-09-20T23:37:01.742Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-20T23:37:02.069 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:01 smithi170 podman[200669]: 2024-09-20 23:37:01.782738824 +0000 UTC m=+0.148269021 container stop 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:02.069 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:01 smithi170 podman[200669]: 2024-09-20 23:37:01.808254299 +0000 UTC m=+0.173784494 container died 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:02.344 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 podman[200669]: 2024-09-20 23:37:02.175293322 +0000 UTC m=+0.540823525 container cleanup 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:02.344 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 bash[200669]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a 2024-09-20T23:37:02.629 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 podman[200681]: 2024-09-20 23:37:02.343044266 +0000 UTC m=+0.554807873 container remove 9e5ce3d709a31f8e371f04c869b6196e444e85ed4240ca0bf2f73a81a91599ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-20T23:37:02.630 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 podman[200681]: 2024-09-20 23:37:02.427027207 +0000 UTC m=+0.638790815 volume remove ebad98684cd527f8bb31290446e2f205bb56213cbf501c9f033732f58c7d895d 2024-09-20T23:37:02.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-20T23:37:02.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 systemd[1]: Stopped Ceph alertmanager.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:37:02.993 INFO:journalctl@ceph.alertmanager.a.smithi170.stdout:Sep 20 23:37:02 smithi170 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@alertmanager.a.service: Consumed 1.925s CPU time. 2024-09-20T23:37:37.043 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 243152d6-77a5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T23:37:39.356 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:39 smithi191 systemd[1]: Stopping Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:37:39.622 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:39 smithi191 podman[180437]: 2024-09-20 23:37:39.355006395 +0000 UTC m=+0.113915114 container died 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:37:39.976 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:39 smithi191 podman[180437]: 2024-09-20 23:37:39.804051202 +0000 UTC m=+0.562959920 container cleanup 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:37:39.976 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:39 smithi191 bash[180437]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b 2024-09-20T23:37:40.411 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:40 smithi191 podman[180448]: 2024-09-20 23:37:40.097538784 +0000 UTC m=+0.746039699 container remove 4c2e538de9fb0e09c1e7f84a397b4dab4d4a046324a9700c0f92d5fe0d400a40 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-20T23:37:40.412 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:40 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-20T23:37:40.412 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:40 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-20T23:37:40.412 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:40 smithi191 systemd[1]: Stopped Ceph node-exporter.b for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:37:40.412 INFO:journalctl@ceph.node-exporter.b.smithi191.stdout:Sep 20 23:37:40 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@node-exporter.b.service: Consumed 3.359s CPU time. 2024-09-20T23:37:40.726 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:40 smithi191 systemd[1]: Stopping Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490... 2024-09-20T23:37:40.726 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:40 smithi191 ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a[55388]: t=2024-09-20T23:37:40+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-09-20T23:37:40.726 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:40 smithi191 podman[180531]: 2024-09-20 23:37:40.527942329 +0000 UTC m=+0.108714266 container died db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, description=Ceph Grafana Container, build-date=2022-03-28T10:36:18.413762, io.k8s.display-name=Red Hat Universal Base Image 8, architecture=x86_64, io.openshift.expose-services=, vcs-type=git, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8, name=ubi8, release=236.1648460182, io.buildah.version=1.24.2, version=8.5, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-09-20T23:37:41.226 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 podman[180531]: 2024-09-20 23:37:41.060041912 +0000 UTC m=+0.640813841 container cleanup db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, build-date=2022-03-28T10:36:18.413762, version=8.5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, name=ubi8, release=236.1648460182, vendor=Red Hat, Inc., io.openshift.expose-services=, vcs-type=git, architecture=x86_64, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.openshift.tags=base rhel8, description=Ceph Grafana Container) 2024-09-20T23:37:41.226 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 bash[180531]: ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a 2024-09-20T23:37:41.726 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 podman[180543]: 2024-09-20 23:37:41.262496537 +0000 UTC m=+0.731772837 container remove db20e868036516533daa9e337c4fb1d518fd1578231e51905740ef0ca0a29bd1 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana-a, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.24.2, version=8.5, build-date=2022-03-28T10:36:18.413762, io.openshift.tags=base rhel8, io.k8s.display-name=Red Hat Universal Base Image 8, release=236.1648460182, com.redhat.component=ubi8-container, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc., description=Ceph Grafana Container, architecture=x86_64, name=ubi8, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI) 2024-09-20T23:37:41.727 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 bash[180557]: Error: no container with name or ID "ceph-243152d6-77a5-11ef-baf5-efdc52797490-grafana.a" found: no such container 2024-09-20T23:37:41.727 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-20T23:37:41.727 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 systemd[1]: Stopped Ceph grafana.a for 243152d6-77a5-11ef-baf5-efdc52797490. 2024-09-20T23:37:41.727 INFO:journalctl@ceph.grafana.a.smithi191.stdout:Sep 20 23:37:41 smithi191 systemd[1]: ceph-243152d6-77a5-11ef-baf5-efdc52797490@grafana.a.service: Consumed 5.222s CPU time. 2024-09-20T23:38:04.530 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:38:04.563 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T23:38:04.592 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-20T23:38:04.593 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi170/crash 2024-09-20T23:38:04.594 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash -- . 2024-09-20T23:38:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T23:38:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2024-09-20T23:38:04.656 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi191/crash 2024-09-20T23:38:04.656 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash -- . 2024-09-20T23:38:04.704 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/243152d6-77a5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T23:38:04.704 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2024-09-20T23:38:04.706 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-20T23:38:04.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_FAILED_DAEMON | egrep -v CEPHADM_AGENT_DOWN | head -n 1 2024-09-20T23:38:04.736 INFO:tasks.cephadm:Compressing logs... 2024-09-20T23:38:04.736 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T23:38:04.779 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T23:38:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-20T23:38:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:: No such file or directory 2024-09-20T23:38:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/tcmu-runner.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr: 87.0% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/tcmu-runner.log.gz 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-20T23:38:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-20T23:38:04.805 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-20T23:38:04.805 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2024-09-20T23:38:04.806 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T23:38:04.806 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-20T23:38:04.806 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T23:38:04.806 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T23:38:04.807 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-20T23:38:04.807 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-20T23:38:04.807 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log 2024-09-20T23:38:04.807 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.5.log: /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-20T23:38:04.809 INFO:teuthology.orchestra.run.smithi191.stderr: 91.3% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T23:38:04.809 INFO:teuthology.orchestra.run.smithi191.stderr: 88.4% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T23:38:04.809 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-20T23:38:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.a.log: 95.0% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T23:38:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-20T23:38:04.813 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi191.blxmkg.log 2024-09-20T23:38:04.824 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi191.hyqqaq.log 2024-09-20T23:38:04.828 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi191.blxmkg.log: 82.5% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi191.blxmkg.log.gz 2024-09-20T23:38:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log 2024-09-20T23:38:04.832 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T23:38:04.832 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi191.hyqqaq.log: 92.7% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T23:38:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi170.dfynrq.log 2024-09-20T23:38:04.841 INFO:teuthology.orchestra.run.smithi191.stderr: 82.5% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi191.hyqqaq.log.gz 2024-09-20T23:38:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-20T23:38:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi170.dfynrq.log: 76.5% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi170.dfynrq.log.gz 2024-09-20T23:38:04.855 INFO:teuthology.orchestra.run.smithi170.stderr: 93.5% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T23:38:04.855 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi170.ojglvq.log 2024-09-20T23:38:04.859 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.3.log: 95.4% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T23:38:04.859 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T23:38:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T23:38:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi170.ojglvq.log: 76.4% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-client.rgw.smpl.smithi170.ojglvq.log.gz 2024-09-20T23:38:04.874 INFO:teuthology.orchestra.run.smithi191.stderr: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T23:38:04.875 INFO:teuthology.orchestra.run.smithi170.stderr: 92.2% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T23:38:04.932 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/cephadm.log: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T23:38:05.086 INFO:teuthology.orchestra.run.smithi170.stderr: 87.8% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-20T23:38:06.083 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-20T23:38:06.188 INFO:teuthology.orchestra.run.smithi191.stderr: 92.9% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-20T23:38:06.233 INFO:teuthology.orchestra.run.smithi191.stderr: 93.6% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-20T23:38:06.368 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-20T23:38:06.512 INFO:teuthology.orchestra.run.smithi170.stderr: 92.8% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-20T23:38:06.540 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-20T23:38:06.904 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-20T23:38:07.041 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-20T23:38:07.178 INFO:teuthology.orchestra.run.smithi191.stderr: 93.6% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-20T23:38:07.327 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-20T23:38:07.329 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-09-20T23:38:07.329 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m2.536s 2024-09-20T23:38:07.329 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m10.733s 2024-09-20T23:38:07.329 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.394s 2024-09-20T23:38:07.374 INFO:teuthology.orchestra.run.smithi170.stderr: 91.7% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-20T23:38:07.432 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/243152d6-77a5-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-20T23:38:07.434 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-20T23:38:07.434 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m2.643s 2024-09-20T23:38:07.434 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m12.355s 2024-09-20T23:38:07.434 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.447s 2024-09-20T23:38:07.435 INFO:tasks.cephadm:Archiving logs... 2024-09-20T23:38:07.435 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi170/log 2024-09-20T23:38:07.436 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T23:38:08.918 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi191/log 2024-09-20T23:38:08.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T23:38:10.193 INFO:tasks.cephadm:Removing cluster... 2024-09-20T23:38:10.193 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 243152d6-77a5-11ef-baf5-efdc52797490 --force 2024-09-20T23:38:10.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 243152d6-77a5-11ef-baf5-efdc52797490 --force 2024-09-20T23:38:10.767 INFO:tasks.cephadm:Removing cephadm ... 2024-09-20T23:38:10.768 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T23:38:10.784 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T23:38:10.799 INFO:tasks.cephadm:Teardown complete 2024-09-20T23:38:10.800 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-20T23:38:10.809 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-20T23:38:10.809 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T23:38:10.827 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T23:38:10.839 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-20T23:38:10.843 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T23:38:10.843 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-20T23:38:10.844 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1396ns[ +11us] +/- 59ms 2024-09-20T23:38:10.844 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -826us[ -826us] +/- 53ms 2024-09-20T23:38:10.844 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +1087us[+1087us] +/- 73ms 2024-09-20T23:38:10.844 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:38:10.853 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-20T23:38:10.857 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T23:38:10.857 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-20T23:38:10.857 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -18us[ -15us] +/- 59ms 2024-09-20T23:38:10.857 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -835us[ -835us] +/- 53ms 2024-09-20T23:38:10.858 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +1069us[+1069us] +/- 73ms 2024-09-20T23:38:10.858 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T23:38:10.858 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-20T23:38:10.867 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-20T23:38:10.867 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-20T23:38:10.912 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T23:38:10.957 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T23:38:10.996 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-20T23:38:11.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:38:11.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-20T23:38:11.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:38:11.061 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-20T23:38:11.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-20T23:38:11.091 INFO:teuthology.task.internal:Duration was 2049.322057 seconds 2024-09-20T23:38:11.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-20T23:38:11.133 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-20T23:38:11.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T23:38:11.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T23:38:11.171 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T23:38:11.172 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T23:38:11.510 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-20T23:38:11.510 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-09-20T23:38:11.511 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T23:38:11.532 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-09-20T23:38:11.532 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T23:38:11.578 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-20T23:38:11.578 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T23:38:11.581 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T23:38:11.644 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-20T23:38:11.644 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T23:38:11.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T23:38:12.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-20T23:38:12.526 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-20T23:38:12.527 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T23:38:12.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T23:38:12.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-20T23:38:12.585 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T23:38:12.593 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T23:38:12.614 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-09-20T23:38:12.639 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-09-20T23:38:12.668 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T23:38:12.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:38:12.689 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T23:38:12.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T23:38:12.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-20T23:38:12.731 INFO:teuthology.task.internal:Transferring archived files... 2024-09-20T23:38:12.731 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi170 2024-09-20T23:38:12.732 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T23:38:12.781 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7913053/remote/smithi191 2024-09-20T23:38:12.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T23:38:12.823 INFO:teuthology.task.internal:Removing archive directory... 2024-09-20T23:38:12.823 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T23:38:12.825 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T23:38:12.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-20T23:38:12.881 INFO:teuthology.task.internal:Not uploading archives. 2024-09-20T23:38:12.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-20T23:38:12.908 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-20T23:38:12.908 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T23:38:12.910 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T23:38:12.923 INFO:teuthology.orchestra.run.smithi170.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 23:38 /home/ubuntu/cephtest 2024-09-20T23:38:12.927 INFO:teuthology.orchestra.run.smithi191.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 23:38 /home/ubuntu/cephtest 2024-09-20T23:38:12.929 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-20T23:38:12.942 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-20T23:38:13.018 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} duration: 2049.3220574855804 owner: scheduled_teuthology@teuthology success: true 2024-09-20T23:38:13.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T23:38:13.167 INFO:teuthology.run:pass